Sep 28 16:54:55 devstack cinder-volume[75464]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 16:54:55 devstack cinder-volume[75464]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 16:54:55 devstack cinder-volume[75464]: we strongly recommend against using it for new projects. Sep 28 16:54:55 devstack cinder-volume[75464]: If you are already using Eventlet, we recommend migrating to a different Sep 28 16:54:55 devstack cinder-volume[75464]: framework. For more detail see Sep 28 16:54:55 devstack cinder-volume[75464]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 16:54:55 devstack cinder-volume[75464]: import eventlet # noqa Sep 28 16:54:57 devstack cinder-volume[75464]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:54:57 devstack cinder-volume[75464]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:54:57 devstack cinder-volume[75464]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:54:58 devstack cinder-volume[75464]: INFO dbcounter [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Registered counter for database cinder Sep 28 16:54:59 devstack cinder-volume[75464]: DEBUG oslo_db.sqlalchemy.engines [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75464) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:54:59 devstack cinder-volume[75464]: DEBUG dbcounter [-] [75464] Writer thread running {{(pid=75464) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 16:54:59 devstack cinder-volume[75464]: INFO cinder.rpc [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 16:54:59 devstack cinder-volume[75464]: INFO cinder.rpc [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 16:54:59 devstack cinder-volume[75464]: DEBUG oslo_db.sqlalchemy.engines [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75464) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:54:59 devstack cinder-volume[75464]: INFO cinder.volume.manager [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Determined volume DB was empty at startup. Sep 28 16:54:59 devstack cinder-volume[75464]: DEBUG cinder.volume.manager [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75464) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 16:54:59 devstack cinder-volume[75464]: INFO cinder.volume.manager [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 16:54:59 devstack cinder-volume[75464]: WARNING stevedore.named [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 16:54:59 devstack cinder-volume[75464]: WARNING castellan.key_manager [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:54:59 devstack cinder-volume[75464]: WARNING cinder.keymgr.conf_key_mgr [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:54:59 devstack cinder-volume[75464]: DEBUG cinder.volume.drivers.lvm [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75464) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 16:54:59 devstack cinder-volume[75464]: DEBUG oslo_concurrency.processutils [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75464) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:54:59 devstack cinder-volume[75464]: DEBUG oslo_concurrency.processutils [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] CMD "cinder-rtstool verify" returned: 0 in 0.437s {{(pid=75464) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_db.sqlalchemy.engines [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75464) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:55:00 devstack cinder-volume[75464]: INFO cinder.rpc [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 16:55:00 devstack cinder-volume[75464]: INFO cinder.rpc [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 16:55:00 devstack cinder-volume[75464]: WARNING stevedore.named [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 16:55:00 devstack cinder-volume[75464]: WARNING castellan.key_manager [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:55:00 devstack cinder-volume[75464]: INFO cinder.volume.manager [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_db.sqlalchemy.engines [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75464) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:55:00 devstack cinder-volume[75464]: INFO oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Starting 1 workers Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Started child 75612 {{(pid=75464) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Full set of CONF: {{(pid=75464) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] ******************************************************************************** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Configuration options gathered from: {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] ================================================================================ {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] allow_availability_zone_fallback = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] allow_compression_on_image_upload = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] allowed_direct_url_schemes = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] api_rate_limit = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] auth_strategy = keystone {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] az_cache_duration = 3600 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75612]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_availability_zone = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_host = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_name = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_stats_polling_interval = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backup_api_class = cinder.backup.api.API {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backup_name_template = backup-%s {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backup_use_same_host = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backup_use_temp_snapshot = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] chap_password = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] chap_username = {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cinder_internal_tenant_project_id = 433c1a89af924a6785744487cae322c8 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cinder_internal_tenant_user_id = ab4da8ca41db474688cece56cae5ccb5 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cloned_volume_same_az = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cluster = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] compression_format = gzip {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] compute_api_class = cinder.compute.nova.API {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] config_dir = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] config_source = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] control_exchange = openstack {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] debug = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] default_availability_zone = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] default_group_type = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] default_volume_type = lvmdriver-1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] disk_geometry = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] driver_client_cert = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] driver_client_cert_key = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] driver_data_namespace = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] driver_ssl_cert_path = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] driver_ssl_cert_verify = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] driver_use_ssl = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] enable_force_upload = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] enable_new_services = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] enable_unsupported_driver = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] enforce_multipath_for_image_xfer = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] filter_function = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance_api_insecure = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance_api_servers = ['http://192.168.122.16/image'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance_api_ssl_compression = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance_ca_certificates_file = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance_catalog_info = image:glance:publicURL {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance_certfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance_keyfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance_num_retries = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance_request_timeout = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] goodness_function = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] graceful_shutdown_timeout = 5 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] group_api_class = cinder.group.api.API {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] host = devstack {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] image_compress_on_upload = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] image_conversion_address_space_limit = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] image_conversion_cpu_limit = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] image_conversion_disable = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] image_introspection_address_space_limit = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] image_introspection_cpu_limit = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] image_upload_use_cinder_backend = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] image_upload_use_internal_tenant = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] image_volume_cache_enabled = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] image_volume_cache_max_count = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] image_volume_cache_max_size_gb = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] init_host_max_objects_retrieval = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] instance_format = [instance: %(uuid)s] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] iscsi_target_flags = {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] iscsi_write_cache = on {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] iser_helper = tgtadm {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] iser_ip_address = 192.168.122.16 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] iser_port = 3260 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] log_color = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] log_config_append = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] log_dir = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] log_file = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] log_options = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] log_rotate_interval = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] log_rotate_interval_type = days {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] log_rotation_type = none {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] max_age = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] max_logfile_count = 30 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] max_logfile_size_mb = 200 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] max_over_subscription_ratio = 20.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] message_reap_interval = 86400 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] message_ttl = 2592000 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] migration_create_volume_timeout_secs = 300 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] monkey_patch = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] monkey_patch_modules = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] my_ip = 192.168.122.16 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] no_snapshot_gb_quota = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] num_iser_scan_tries = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] num_shell_tries = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] num_volume_device_scan_tries = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] nvmeof_conn_info_version = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] nvmet_ns_id = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] nvmet_port_id = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] osapi_max_limit = 1000 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] osapi_volume_ext_list = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] osapi_volume_listen_port = 8776 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] osapi_volume_use_ssl = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] osapi_volume_workers = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] per_volume_size_limit = -1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] periodic_fuzzy_delay = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] periodic_interval = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] public_endpoint = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] publish_errors = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] quota_backup_gigabytes = 1000 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] quota_backups = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] quota_gigabytes = 1000 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] quota_groups = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] quota_snapshots = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] quota_volumes = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] rate_limit_burst = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] rate_limit_except_level = CRITICAL {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] rate_limit_interval = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] reinit_driver_count = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] replication_device = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] report_discard_supported = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] report_interval = 120 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] reservation_clean_interval = 86400 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] reservation_expire = 86400 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] reserved_image_namespaces = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] reserved_percentage = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] rpc_response_timeout = 120 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] run_external_periodic_tasks = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] scst_target_driver = iscsi {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] scst_target_iqn_name = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] service_down_time = 720 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75612]: INFO cinder.volume.manager [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] shell_completion = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] snapshot_name_template = snapshot-%s {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] snapshot_same_host = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] split_loggers = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] state_path = /opt/stack/data/cinder {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] storage_availability_zone = nova {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] storage_protocol = iSCSI {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] syslog_log_facility = LOG_USER {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] target_helper = lioadm {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] target_ip_address = 192.168.122.16 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] target_port = 3260 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] target_protocol = iscsi {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] target_secondary_ip_addresses = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] trace_flags = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] transport_url = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] until_refresh = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] use_chap_auth = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] use_default_quota_class = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] use_journal = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] use_json = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] use_multipath_for_image_xfer = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] use_stderr = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] use_syslog = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] verify_glance_signatures = enabled {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] volume_api_class = cinder.volume.api.API {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] volume_backend_name = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] volume_clear = zero {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] volume_clear_ionice = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] volume_clear_size = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] volume_copy_bps_limit = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] volume_dd_blocksize = 1M {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] volume_name_template = volume-%s {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] volume_service_inithost_offload = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] volume_usage_audit_period = month {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] zoning_mode = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_concurrency.disable_process_locking = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.auth_section = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.auth_type = password {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.auth_version = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.cache = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.certfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.include_service_catalog = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.insecure = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.interface = public {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.keyfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.memcache_password = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.memcache_username = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.region_name = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.service_type = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.16/identity {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.backend = dogpile.cache.null {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.backend_argument = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.backend_expiration_time = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.config_prefix = cache.oslo {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.debug_cache_backend = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.enable_retry_client = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.enable_socket_keepalive = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.enabled = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.expiration_time = 600 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.hashclient_retry_attempts = 2 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.memcache_dead_retry = 300 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.memcache_pool_maxsize = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.memcache_sasl_enabled = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.password = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.proxies = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.redis_db = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.redis_server = localhost:6379 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.retry_attempts = 2 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.retry_delay = 0.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.socket_keepalive_count = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.socket_keepalive_idle = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.socket_keepalive_interval = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.socket_timeout = 1.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.tls_allowed_ciphers = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.tls_cafile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.tls_certfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.tls_enabled = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.tls_keyfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cache.username = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] coordination.backend_url = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.asyncio_connection = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.asyncio_slave_connection = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.backend = sqlalchemy {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.connection = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.connection_debug = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.connection_parameters = {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.connection_recycle_time = 3600 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.connection_trace = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.db_inc_retry_interval = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.db_max_retries = 20 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.db_max_retry_interval = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.db_retry_interval = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.max_overflow = 50 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.max_pool_size = 5 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.max_retries = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack sudo[75616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.mysql_wsrep_sync_wait = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.pool_timeout = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.retry_interval = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack sudo[75616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.slave_connection = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.sqlite_synchronous = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.synchronous_reader = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] database.use_db_reconnect = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_tracing.insecure = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] profiler.connection_string = messaging:// {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] profiler.enabled = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] profiler.es_doc_type = notification {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] profiler.es_scroll_size = 10000 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] profiler.es_scroll_time = 2m {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] profiler.filter_error_trace = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] profiler.hmac_keys = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] profiler.sentinel_service_name = mymaster {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] profiler.socket_timeout = 0.1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] profiler.trace_requests = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] profiler.trace_sqlalchemy = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] profiler_jaeger.process_tags = {} {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] profiler_jaeger.service_name_prefix = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] profiler_otlp.service_name_prefix = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_policy.enforce_new_defaults = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_policy.policy_default_rule = default {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_policy.policy_file = policy.yaml {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] privsep_osbrick.group = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] privsep_osbrick.helper_command = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] privsep_osbrick.user = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cinder_sys_admin.group = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cinder_sys_admin.helper_command = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] cinder_sys_admin.user = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] service_user.auth_section = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] service_user.auth_type = password {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] service_user.cafile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] service_user.certfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] service_user.collect_timing = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] service_user.insecure = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] service_user.keyfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] service_user.send_service_user_token = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] service_user.split_loggers = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] service_user.timeout = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] service_user.tls_ciphers = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] service_user.tls_min_version = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance.auth_section = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance.auth_type = password {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance.certfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance.collect_timing = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance.insecure = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance.keyfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance.region_name = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance.split_loggers = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance.timeout = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance.tls_ciphers = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] glance.tls_min_version = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.backend_availability_zone = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.chap_password = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.chap_username = {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.disk_geometry = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.driver_client_cert = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.driver_client_cert_key = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.driver_data_namespace = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.driver_use_ssl = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.extra_capabilities = {} {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.filter_function = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.goodness_function = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.iscsi_target_flags = {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.iscsi_write_cache = on {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.iser_helper = tgtadm {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.iser_ip_address = 192.168.122.16 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.iser_port = 3260 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.lvm_share_target = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.lvm_type = auto {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.num_shell_tries = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.replication_device = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.report_discard_supported = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.reserved_percentage = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.target_helper = tgtadm {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.target_ip_address = 192.168.122.16 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.target_port = 3260 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.target_protocol = iscsi {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.trace_flags = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.unique_fqdn_network = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.use_chap_auth = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.volume_backend_name = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.volume_clear = zero {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.volume_clear_ionice = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.volume_clear_size = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_reports.file_event_handler = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_reports.log_dir = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.backend_host = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.chap_password = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.chap_username = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.disk_geometry = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.driver_client_cert = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.extra_capabilities = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.filter_function = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.goodness_function = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.iser_helper = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.iser_ip_address = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.iser_port = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.lvm_share_target = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.lvm_type = auto {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.num_shell_tries = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.replication_device = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.report_discard_supported = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.reserved_percentage = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.scst_target_driver = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.storage_protocol = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.target_helper = lioadm {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.target_ip_address = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.target_port = 3260 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.trace_flags = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.use_chap_auth = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.volume_clear = zero {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.volume_clear_size = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] lvmdriver-1.volumes_dir = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.ssl = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_notifications.driver = [] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_notifications.retry = -1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] key_manager.fixed_key = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.barbican_api_version = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.barbican_endpoint = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.barbican_endpoint_type = public {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.barbican_region_name = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.cafile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.certfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.collect_timing = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.insecure = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.keyfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.number_of_retries = 60 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.retry_delay = 1 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.send_service_user_token = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.split_loggers = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.timeout = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.tls_ciphers = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.tls_min_version = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.verify_ssl = True {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican.verify_ssl_path = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican_service_user.auth_section = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican_service_user.auth_type = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican_service_user.cafile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican_service_user.certfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican_service_user.collect_timing = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican_service_user.insecure = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican_service_user.keyfile = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican_service_user.split_loggers = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican_service_user.timeout = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican_service_user.tls_ciphers = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] barbican_service_user.tls_min_version = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] vault.approle_role_id = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] vault.approle_secret_id = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] vault.auth_method = approle {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] vault.auth_path = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] vault.kv_mountpoint = secret {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] vault.kv_path = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] vault.kv_version = 2 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] vault.namespace = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] vault.root_token_id = **** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] vault.ssl_ca_crt_file = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] vault.timeout = 60.0 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] vault.token_file = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] vault.token_role = None {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] vault.use_ssl = False {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:00 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] ******************************************************************************** {{(pid=75464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 16:55:00 devstack sudo[75616]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:00 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.404s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:00 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:00 devstack sudo[75784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:00 devstack sudo[75784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:01 devstack sudo[75784]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:01 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.253s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:01 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:55:01 devstack cinder-volume[75612]: INFO cinder.brick.local_dev.lvm [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 16:55:01 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:01 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:01 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:01 devstack sudo[75879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:01 devstack sudo[75879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:01 devstack sudo[75879]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:01 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:01 devstack cinder-volume[75612]: DEBUG cinder.brick.local_dev.lvm [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75612) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 16:55:01 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:01 devstack sudo[75982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:01 devstack sudo[75982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:01 devstack sudo[75982]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:01 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.635s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:01 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:01 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:02 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:02 devstack sudo[76313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:02 devstack sudo[76313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:02 devstack sudo[76313]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:02 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:02 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:02 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:02 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:02 devstack sudo[76481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 16:55:02 devstack sudo[76481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:02 devstack sudo[76481]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:02 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.385s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:02 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:02 devstack sudo[76646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:02 devstack sudo[76646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:02 devstack sudo[76646]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:02 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:02 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:03 devstack sudo[76655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:03 devstack sudo[76655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:03 devstack sudo[76655]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:03 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.352s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:03 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:03 devstack sudo[76738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:03 devstack sudo[76738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:03 devstack sudo[76738]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:03 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:03 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:03 devstack sudo[76741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:03 devstack sudo[76741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:03 devstack sudo[76741]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:03 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:03 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:03 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:03 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:03 devstack sudo[76745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:03 devstack sudo[76745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:04 devstack sudo[76745]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:04 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:04 devstack cinder-volume[75612]: INFO cinder.volume.drivers.lvm [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 16:55:04 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:04 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:04 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:04 devstack sudo[76749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:04 devstack sudo[76749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:04 devstack sudo[76749]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:04 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:04 devstack cinder-volume[75612]: DEBUG cinder.volume.drivers.lvm [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Updating volume stats {{(pid=75612) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:55:04 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:04 devstack sudo[76758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:04 devstack sudo[76758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:04 devstack sudo[76758]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:04 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:04 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:04 devstack sudo[76761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:04 devstack sudo[76761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:05 devstack sudo[76761]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:05 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:05 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:05 devstack sudo[76764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:05 devstack sudo[76764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:05 devstack sudo[76764]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:05 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:05 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:05 devstack sudo[76767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:05 devstack sudo[76767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:05 devstack sudo[76767]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:05 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:05 devstack cinder-volume[75612]: INFO cinder.volume.driver [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 16:55:05 devstack cinder-volume[75612]: DEBUG cinder.volume.driver [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75612) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 16:55:05 devstack cinder-volume[75612]: DEBUG oslo_db.sqlalchemy.engines [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75612) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:55:05 devstack cinder-volume[75612]: DEBUG dbcounter [-] [75612] Writer thread running {{(pid=75612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 16:55:05 devstack cinder-volume[75612]: DEBUG cinder.db.api [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Building query based on filter {{(pid=75612) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 16:55:05 devstack cinder-volume[75612]: DEBUG cinder.image.image_utils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75612) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 16:55:05 devstack cinder-volume[75612]: INFO cinder.keymgr.migration [None req-4e455cf8-21ea-49f2-ae67-7f2b17976036 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 16:55:05 devstack cinder-volume[75612]: DEBUG cinder.volume.drivers.lvm [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Updating volume stats {{(pid=75612) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:55:05 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:05 devstack sudo[76772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:05 devstack sudo[76772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:06 devstack sudo[76772]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:06 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.348s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:06 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:06 devstack sudo[76776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:06 devstack sudo[76776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:06 devstack sudo[76776]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:06 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:06 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:06 devstack sudo[76779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:06 devstack sudo[76779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:06 devstack sudo[76779]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:06 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:06 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:06 devstack sudo[76782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:06 devstack sudo[76782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:06 devstack sudo[76782]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:06 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:06 devstack cinder-volume[75612]: DEBUG cinder.manager [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Notifying Schedulers of capabilities ... {{(pid=75612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:55:06 devstack cinder-volume[75612]: INFO cinder.volume.manager [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Driver initialization completed successfully. Sep 28 16:55:06 devstack cinder-volume[75612]: INFO cinder.manager [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Initiating service 2 cleanup Sep 28 16:55:06 devstack cinder-volume[75612]: INFO cinder.manager [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Service 2 cleanup completed. Sep 28 16:55:06 devstack cinder-volume[75612]: DEBUG cinder.service [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Creating RPC server for service cinder-volume {{(pid=75612) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 16:55:06 devstack cinder-volume[75612]: DEBUG cinder.service [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75612) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 16:55:07 devstack cinder-volume[75612]: INFO cinder.volume.manager [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 16:55:07 devstack cinder-volume[75612]: DEBUG cinder.volume.drivers.lvm [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Updating volume stats {{(pid=75612) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:55:07 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:07 devstack sudo[76787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:07 devstack sudo[76787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:07 devstack sudo[76787]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:07 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:07 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:07 devstack sudo[76790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:07 devstack sudo[76790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:07 devstack sudo[76790]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:07 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:07 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:07 devstack sudo[76793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:07 devstack sudo[76793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:07 devstack sudo[76793]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:07 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:07 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:07 devstack sudo[76799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:07 devstack sudo[76799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:08 devstack sudo[76799]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:08 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:08 devstack cinder-volume[75612]: INFO cinder.volume.manager [None req-38d2c502-b3be-45ff-8442-6849a4793d96 None None] Driver post RPC initialization completed successfully. Sep 28 16:55:10 devstack cinder-volume[75464]: DEBUG dbcounter [-] [75464] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75464) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:55:18 devstack cinder-volume[75612]: DEBUG dbcounter [-] [75612] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:55:18 devstack cinder-volume[75612]: DEBUG dbcounter [-] [75612] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:55:59 devstack cinder-volume[75612]: DEBUG oslo_service.periodic_task [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:55:59 devstack cinder-volume[75612]: DEBUG cinder.volume.drivers.lvm [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Updating volume stats {{(pid=75612) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:55:59 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:59 devstack sudo[78748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:59 devstack sudo[78748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:59 devstack sudo[78748]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:59 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:59 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:59 devstack sudo[78751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:59 devstack sudo[78751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:59 devstack sudo[78751]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:59 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:59 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:59 devstack sudo[78754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:59 devstack sudo[78754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:59 devstack sudo[78754]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:59 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:59 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:59 devstack sudo[78757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:59 devstack sudo[78757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:56:00 devstack sudo[78757]: pam_unix(sudo:session): session closed for user root Sep 28 16:56:00 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:56:00 devstack cinder-volume[75612]: DEBUG cinder.manager [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Notifying Schedulers of capabilities ... {{(pid=75612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:56:00 devstack cinder-volume[75612]: DEBUG oslo_service.periodic_task [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running periodic task VolumeManager._thread_info {{(pid=75612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:56:00 devstack cinder-volume[75612]: DEBUG cinder.volume.manager [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] thread count: 6 {{(pid=75612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:56:00 devstack cinder-volume[75612]: DEBUG cinder.volume.manager [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] thread info: [<_MainThread(MainThread, started 130911334428800)>, , , , , ] {{(pid=75612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:56:59 devstack cinder-volume[75612]: DEBUG oslo_service.periodic_task [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:56:59 devstack cinder-volume[75612]: DEBUG cinder.volume.drivers.lvm [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Updating volume stats {{(pid=75612) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:56:59 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:56:59 devstack sudo[82053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:56:59 devstack sudo[82053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:56:59 devstack sudo[82053]: pam_unix(sudo:session): session closed for user root Sep 28 16:56:59 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:56:59 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:56:59 devstack sudo[82056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:56:59 devstack sudo[82056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:56:59 devstack sudo[82056]: pam_unix(sudo:session): session closed for user root Sep 28 16:56:59 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:56:59 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:56:59 devstack sudo[82060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:56:59 devstack sudo[82060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:00 devstack sudo[82060]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:00 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:00 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:00 devstack sudo[82064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:57:00 devstack sudo[82064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:00 devstack sudo[82064]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:00 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:00 devstack cinder-volume[75612]: DEBUG cinder.manager [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Notifying Schedulers of capabilities ... {{(pid=75612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:57:00 devstack cinder-volume[75612]: DEBUG oslo_service.periodic_task [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running periodic task VolumeManager._thread_info {{(pid=75612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:57:00 devstack cinder-volume[75612]: DEBUG cinder.volume.manager [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] thread count: 6 {{(pid=75612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:57:00 devstack cinder-volume[75612]: DEBUG cinder.volume.manager [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] thread info: [<_MainThread(MainThread, started 130911334428800)>, , , , , ] {{(pid=75612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:57:18 devstack cinder-volume[75612]: DEBUG dbcounter [-] [75612] Writing DB stats cinder:SELECT=1 {{(pid=75612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:57:18 devstack cinder-volume[75612]: DEBUG dbcounter [-] [75612] Writing DB stats cinder:UPDATE=1 {{(pid=75612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:58:59 devstack cinder-volume[75612]: DEBUG oslo_service.periodic_task [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:58:59 devstack cinder-volume[75612]: DEBUG cinder.volume.drivers.lvm [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Updating volume stats {{(pid=75612) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:58:59 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:58:59 devstack sudo[85157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:58:59 devstack sudo[85157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:58:59 devstack sudo[85157]: pam_unix(sudo:session): session closed for user root Sep 28 16:58:59 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:58:59 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:58:59 devstack sudo[85161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:58:59 devstack sudo[85161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:58:59 devstack sudo[85161]: pam_unix(sudo:session): session closed for user root Sep 28 16:58:59 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:58:59 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:58:59 devstack sudo[85164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:58:59 devstack sudo[85164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:00 devstack sudo[85164]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:00 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:00 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:00 devstack sudo[85178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:59:00 devstack sudo[85178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:00 devstack sudo[85178]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:00 devstack cinder-volume[75612]: DEBUG oslo_concurrency.processutils [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:00 devstack cinder-volume[75612]: DEBUG cinder.manager [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Notifying Schedulers of capabilities ... {{(pid=75612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:59:00 devstack cinder-volume[75612]: DEBUG oslo_service.periodic_task [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] Running periodic task VolumeManager._thread_info {{(pid=75612) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:59:00 devstack cinder-volume[75612]: DEBUG cinder.volume.manager [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] thread count: 6 {{(pid=75612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:59:00 devstack cinder-volume[75612]: DEBUG cinder.volume.manager [None req-ead24809-8f09-48ab-af53-dcd129adec82 None None] thread info: [<_MainThread(MainThread, started 130911334428800)>, , , , , ] {{(pid=75612) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:59:18 devstack cinder-volume[75612]: DEBUG dbcounter [-] [75612] Writing DB stats cinder:SELECT=1 {{(pid=75612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:59:18 devstack cinder-volume[75612]: DEBUG dbcounter [-] [75612] Writing DB stats cinder:UPDATE=1 {{(pid=75612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:59:37 devstack cinder-volume[75464]: INFO oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Caught SIGTERM, stopping children Sep 28 16:59:37 devstack cinder-volume[75464]: DEBUG oslo_concurrency.lockutils [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Acquiring lock "singleton_lock" {{(pid=75464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:59:37 devstack cinder-volume[75464]: DEBUG oslo_concurrency.lockutils [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Acquired lock "singleton_lock" {{(pid=75464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:59:37 devstack cinder-volume[75464]: DEBUG oslo_concurrency.lockutils [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Releasing lock "singleton_lock" {{(pid=75464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:59:37 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Stop services. {{(pid=75464) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 16:59:37 devstack cinder-volume[75464]: DEBUG oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Killing children. {{(pid=75464) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 16:59:37 devstack cinder-volume[75464]: INFO oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Waiting on 1 children to exit Sep 28 16:59:42 devstack cinder-volume[75612]: DEBUG oslo_concurrency.lockutils [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Acquiring lock "singleton_lock" {{(pid=75612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:59:42 devstack cinder-volume[75612]: DEBUG oslo_concurrency.lockutils [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Acquired lock "singleton_lock" {{(pid=75612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:59:42 devstack cinder-volume[75612]: DEBUG oslo_concurrency.lockutils [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Releasing lock "singleton_lock" {{(pid=75612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:59:42 devstack cinder-volume[75612]: WARNING amqp [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 16:59:42 devstack cinder-volume[75612]: WARNING amqp [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 16:59:42 devstack cinder-volume[75464]: INFO oslo_service.backend._eventlet.service [None req-6f777a61-684e-444b-ad98-d191d5da6e36 None None] Child 75612 exited with status 0 Sep 28 16:59:42 devstack cinder-volume[86003]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 16:59:42 devstack cinder-volume[86003]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 16:59:42 devstack cinder-volume[86003]: we strongly recommend against using it for new projects. Sep 28 16:59:42 devstack cinder-volume[86003]: If you are already using Eventlet, we recommend migrating to a different Sep 28 16:59:42 devstack cinder-volume[86003]: framework. For more detail see Sep 28 16:59:42 devstack cinder-volume[86003]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 16:59:42 devstack cinder-volume[86003]: import eventlet # noqa Sep 28 16:59:44 devstack cinder-volume[86003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:59:44 devstack cinder-volume[86003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:59:44 devstack cinder-volume[86003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:59:45 devstack cinder-volume[86003]: INFO dbcounter [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Registered counter for database cinder Sep 28 16:59:45 devstack cinder-volume[86003]: DEBUG oslo_db.sqlalchemy.engines [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86003) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:59:45 devstack cinder-volume[86003]: DEBUG dbcounter [-] [86003] Writer thread running {{(pid=86003) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 16:59:45 devstack cinder-volume[86003]: INFO cinder.rpc [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 16:59:45 devstack cinder-volume[86003]: INFO cinder.rpc [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 16:59:45 devstack cinder-volume[86003]: DEBUG oslo_db.sqlalchemy.engines [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86003) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:59:45 devstack cinder-volume[86003]: INFO cinder.volume.manager [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Determined volume DB was empty at startup. Sep 28 16:59:45 devstack cinder-volume[86003]: DEBUG cinder.volume.manager [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86003) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 16:59:45 devstack cinder-volume[86003]: INFO cinder.volume.manager [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 16:59:45 devstack cinder-volume[86003]: WARNING stevedore.named [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 16:59:45 devstack cinder-volume[86003]: WARNING castellan.key_manager [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:59:45 devstack cinder-volume[86003]: WARNING cinder.keymgr.conf_key_mgr [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:59:45 devstack cinder-volume[86003]: INFO cinder.volume.manager [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_db.sqlalchemy.engines [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86003) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:59:46 devstack cinder-volume[86003]: INFO oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Starting 1 workers Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Started child 86222 {{(pid=86003) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Full set of CONF: {{(pid=86003) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] ******************************************************************************** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Configuration options gathered from: {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] ================================================================================ {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] allow_availability_zone_fallback = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] allow_compression_on_image_upload = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] allowed_direct_url_schemes = [] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] api_rate_limit = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86222]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] auth_strategy = keystone {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_availability_zone = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_host = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_name = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_stats_polling_interval = 60 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backup_api_class = cinder.backup.api.API {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backup_name_template = backup-%s {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backup_use_same_host = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backup_use_temp_snapshot = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] chap_password = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] chap_username = {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cinder_internal_tenant_project_id = 433c1a89af924a6785744487cae322c8 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cinder_internal_tenant_user_id = ab4da8ca41db474688cece56cae5ccb5 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cluster = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] compression_format = gzip {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] compute_api_class = cinder.compute.nova.API {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] config_dir = [] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] config_source = [] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] control_exchange = openstack {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] debug = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] default_availability_zone = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] default_group_type = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] default_volume_type = QuobyteHD {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] disk_geometry = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] driver_client_cert = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] driver_client_cert_key = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] driver_data_namespace = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] driver_ssl_cert_path = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] driver_ssl_cert_verify = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] driver_use_ssl = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] enable_new_services = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] enable_unsupported_driver = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] enabled_backends = ['QuobyteHD'] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] enforce_multipath_for_image_xfer = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] filter_function = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance_api_insecure = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance_api_servers = ['http://192.168.122.16/image'] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance_api_ssl_compression = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance_ca_certificates_file = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance_catalog_info = image:glance:publicURL {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance_certfile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance_keyfile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance_num_retries = 3 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance_request_timeout = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] goodness_function = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] graceful_shutdown_timeout = 5 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] group_api_class = cinder.group.api.API {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] host = devstack {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] image_compress_on_upload = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] image_conversion_address_space_limit = 1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] image_conversion_cpu_limit = 60 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] image_conversion_disable = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] image_introspection_address_space_limit = 1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] image_introspection_cpu_limit = 60 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] image_upload_use_cinder_backend = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] image_upload_use_internal_tenant = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] image_volume_cache_enabled = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] image_volume_cache_max_count = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] image_volume_cache_max_size_gb = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] init_host_max_objects_retrieval = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] instance_format = [instance: %(uuid)s] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] iscsi_target_flags = {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] iscsi_write_cache = on {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] iser_helper = tgtadm {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] iser_ip_address = 192.168.122.16 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] iser_port = 3260 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] log_color = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] log_config_append = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] log_dir = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] log_file = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] log_options = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] log_rotate_interval = 1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] log_rotate_interval_type = days {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] log_rotation_type = none {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86222]: INFO cinder.volume.manager [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86222]: DEBUG cinder.volume.drivers.remotefs [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86222) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] max_age = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] max_logfile_count = 30 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] max_logfile_size_mb = 200 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] max_over_subscription_ratio = 20.0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] message_reap_interval = 86400 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] message_ttl = 2592000 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] migration_create_volume_timeout_secs = 300 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] monkey_patch = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] monkey_patch_modules = [] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] my_ip = 192.168.122.16 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] no_snapshot_gb_quota = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] num_iser_scan_tries = 3 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] num_shell_tries = 3 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] num_volume_device_scan_tries = 3 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] nvmeof_conn_info_version = 1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] nvmet_ns_id = 10 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] nvmet_port_id = 1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] osapi_max_limit = 1000 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] osapi_volume_ext_list = [] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] osapi_volume_listen_port = 8776 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] osapi_volume_use_ssl = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] osapi_volume_workers = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] per_volume_size_limit = -1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] periodic_fuzzy_delay = 60 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] periodic_interval = 60 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] public_endpoint = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] publish_errors = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] quota_backup_gigabytes = 1000 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] quota_backups = 10 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] quota_gigabytes = 1000 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] quota_groups = 10 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] quota_snapshots = 10 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] quota_volumes = 10 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] rate_limit_burst = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] rate_limit_except_level = CRITICAL {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] rate_limit_interval = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] reinit_driver_count = 3 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] replication_device = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] report_discard_supported = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] report_interval = 120 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] reservation_clean_interval = 86400 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] reservation_expire = 86400 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] reserved_image_namespaces = [] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] reserved_percentage = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] rpc_response_timeout = 120 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] run_external_periodic_tasks = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] scst_target_driver = iscsi {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] scst_target_iqn_name = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] service_down_time = 720 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] shell_completion = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] snapshot_name_template = snapshot-%s {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] split_loggers = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] state_path = /opt/stack/data/cinder {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] storage_availability_zone = nova {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] storage_protocol = iSCSI {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] syslog_log_facility = LOG_USER {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] target_helper = lioadm {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] target_ip_address = 192.168.122.16 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] target_port = 3260 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] target_protocol = iscsi {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] target_secondary_ip_addresses = [] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] trace_flags = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] transport_url = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] until_refresh = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] use_chap_auth = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] use_default_quota_class = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] use_journal = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] use_json = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] use_multipath_for_image_xfer = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] use_stderr = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] use_syslog = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] verify_glance_signatures = enabled {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] volume_api_class = cinder.volume.api.API {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] volume_backend_name = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] volume_clear = zero {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] volume_clear_ionice = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] volume_clear_size = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] volume_copy_bps_limit = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] volume_dd_blocksize = 1M {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] volume_name_template = volume-%s {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] volume_service_inithost_offload = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] volume_usage_audit_period = month {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] zoning_mode = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_concurrency.disable_process_locking = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.auth_section = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.auth_type = password {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.auth_version = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.cache = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.certfile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.include_service_catalog = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.insecure = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.interface = public {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.keyfile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.memcache_password = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.memcache_username = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.region_name = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.service_type = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.16/identity {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.backend = dogpile.cache.null {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.backend_argument = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.backend_expiration_time = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.config_prefix = cache.oslo {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.debug_cache_backend = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.enable_retry_client = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.enable_socket_keepalive = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.enabled = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.expiration_time = 600 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.hashclient_retry_attempts = 2 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.memcache_dead_retry = 300 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.memcache_pool_maxsize = 10 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.memcache_sasl_enabled = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86222]: DEBUG cinder.volume.drivers.quobyte [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86222) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 16:59:46 devstack cinder-volume[86222]: WARNING cinder.volume.drivers.quobyte [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 16:59:46 devstack cinder-volume[86222]: WARNING cinder.volume.drivers.quobyte [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.password = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86222]: DEBUG oslo_concurrency.processutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Running cmd (subprocess): mount.quobyte {{(pid=86222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.proxies = [] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.redis_db = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.redis_server = localhost:6379 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.retry_attempts = 2 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.retry_delay = 0.0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.socket_keepalive_count = 1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.socket_keepalive_idle = 1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.socket_keepalive_interval = 1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.socket_timeout = 1.0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.tls_allowed_ciphers = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.tls_cafile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.tls_certfile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.tls_enabled = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.tls_keyfile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cache.username = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] coordination.backend_url = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.asyncio_connection = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.asyncio_slave_connection = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.backend = sqlalchemy {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.connection = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.connection_debug = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.connection_parameters = {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.connection_recycle_time = 3600 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.connection_trace = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.db_inc_retry_interval = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.db_max_retries = 20 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.db_max_retry_interval = 10 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.db_retry_interval = 1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.max_overflow = 50 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.max_pool_size = 5 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.max_retries = 10 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.mysql_wsrep_sync_wait = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.pool_timeout = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.retry_interval = 10 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.slave_connection = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.sqlite_synchronous = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.synchronous_reader = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] database.use_db_reconnect = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_tracing.insecure = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] profiler.connection_string = messaging:// {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] profiler.enabled = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] profiler.es_doc_type = notification {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] profiler.es_scroll_size = 10000 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] profiler.es_scroll_time = 2m {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] profiler.filter_error_trace = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] profiler.hmac_keys = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] profiler.sentinel_service_name = mymaster {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] profiler.socket_timeout = 0.1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] profiler.trace_requests = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] profiler.trace_sqlalchemy = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] profiler_jaeger.process_tags = {} {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] profiler_jaeger.service_name_prefix = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] profiler_otlp.service_name_prefix = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_policy.enforce_new_defaults = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_policy.policy_default_rule = default {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_policy.policy_file = policy.yaml {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] privsep_osbrick.group = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] privsep_osbrick.helper_command = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] privsep_osbrick.user = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cinder_sys_admin.group = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cinder_sys_admin.helper_command = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] cinder_sys_admin.user = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] service_user.auth_section = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] service_user.auth_type = password {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] service_user.cafile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] service_user.certfile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] service_user.collect_timing = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] service_user.insecure = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] service_user.keyfile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] service_user.send_service_user_token = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] service_user.split_loggers = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] service_user.timeout = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] service_user.tls_ciphers = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] service_user.tls_min_version = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance.auth_section = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance.auth_type = password {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance.certfile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance.collect_timing = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance.insecure = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance.keyfile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance.region_name = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance.split_loggers = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance.timeout = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance.tls_ciphers = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] glance.tls_min_version = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.backend_availability_zone = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.chap_password = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.chap_username = {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.disk_geometry = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.driver_client_cert = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.driver_client_cert_key = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.driver_data_namespace = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.driver_use_ssl = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.extra_capabilities = {} {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.filter_function = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.goodness_function = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.iscsi_target_flags = {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.iscsi_write_cache = on {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.iser_helper = tgtadm {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.iser_ip_address = 192.168.122.16 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.iser_port = 3260 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.nas_host = {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.nas_login = admin {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.nas_mount_options = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.nas_password = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.nas_private_key = {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.nas_share_path = {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.num_shell_tries = 3 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.quobyte_volume_url = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.replication_device = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.report_discard_supported = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.reserved_percentage = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.target_helper = tgtadm {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.target_ip_address = 192.168.122.16 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.target_port = 3260 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.target_protocol = iscsi {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.trace_flags = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack quobyte-client[86225]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 16:59:46 devstack quobyte-client[86225]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.unique_fqdn_network = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.use_chap_auth = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.volume_backend_name = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.volume_clear = zero {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.volume_clear_ionice = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86222]: DEBUG oslo_concurrency.processutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] CMD "mount.quobyte" returned: 1 in 0.134s {{(pid=86222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.volume_clear_size = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_reports.file_event_handler = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86222) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:59:46 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86222) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:59:46 devstack cinder-volume[86222]: DEBUG cinder.volume.drivers.quobyte [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86222) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:59:46 devstack cinder-volume[86222]: INFO cinder.volume.drivers.quobyte [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 ... Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_reports.log_dir = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.backend_availability_zone = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.backend_host = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86222]: DEBUG oslo_concurrency.processutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c -c /etc/quobyte/client-cinder.cfg {{(pid=86222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.chap_password = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.chap_username = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.chiscsi_conf = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.disk_geometry = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.driver_client_cert = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.driver_data_namespace = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.driver_use_ssl = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.extra_capabilities = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.filter_function = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.goodness_function = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.iser_helper = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.iser_ip_address = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.iser_port = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.iser_target_prefix = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.nas_host = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.nas_login = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.nas_mount_options = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.nas_password = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.nas_private_key = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.nas_share_path = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.nas_ssh_port = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.num_shell_tries = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack sudo[86228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c -c /etc/quobyte/client-cinder.cfg Sep 28 16:59:46 devstack sudo[86228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.nvmet_port_id = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.replication_device = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.report_discard_supported = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.reserved_percentage = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.scst_target_driver = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.storage_protocol = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.target_helper = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.target_ip_address = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.target_port = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.target_prefix = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.target_protocol = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.trace_flags = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.use_chap_auth = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.volume_clear = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.volume_clear_size = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] QuobyteHD.volumes_dir = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.ssl = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_notifications.driver = [] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_notifications.retry = -1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] key_manager.fixed_key = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.barbican_api_version = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.barbican_endpoint = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.barbican_endpoint_type = public {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.barbican_region_name = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.cafile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.certfile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.collect_timing = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.insecure = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.keyfile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.number_of_retries = 60 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.retry_delay = 1 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.send_service_user_token = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.split_loggers = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.timeout = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.tls_ciphers = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.tls_min_version = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.verify_ssl = True {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican.verify_ssl_path = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican_service_user.auth_section = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican_service_user.auth_type = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican_service_user.cafile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican_service_user.certfile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican_service_user.collect_timing = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican_service_user.insecure = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican_service_user.keyfile = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican_service_user.split_loggers = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican_service_user.timeout = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican_service_user.tls_ciphers = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] barbican_service_user.tls_min_version = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] vault.approle_role_id = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] vault.approle_secret_id = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] vault.auth_method = approle {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] vault.auth_path = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] vault.kv_mountpoint = secret {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] vault.kv_path = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] vault.kv_version = 2 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] vault.namespace = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] vault.root_token_id = **** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] vault.ssl_ca_crt_file = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] vault.timeout = 60.0 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] vault.token_file = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] vault.token_role = None {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] vault.use_ssl = False {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:46 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] ******************************************************************************** {{(pid=86003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 16:59:46 devstack sudo[86228]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:46 devstack cinder-volume[86222]: DEBUG oslo_concurrency.processutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.452s {{(pid=86222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:46 devstack cinder-volume[86222]: INFO cinder.volume.drivers.quobyte [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 succeeded Sep 28 16:59:46 devstack cinder-volume[86222]: DEBUG cinder.volume.drivers.quobyte [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86222) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:59:46 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.462s {{(pid=86222) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:59:46 devstack cinder-volume[86222]: DEBUG oslo_concurrency.processutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:46 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 16:59:46 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:47 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG oslo_concurrency.processutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.260s {{(pid=86222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:47 devstack cinder-volume[86222]: INFO cinder.volume.driver [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Driver hasn't implemented _init_vendor_properties() Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG cinder.volume.driver [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.153392791748, 'free_capacity_gb': 1775.153392791748, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86222) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG oslo_db.sqlalchemy.engines [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG dbcounter [-] [86222] Writer thread running {{(pid=86222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG cinder.db.api [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Building query based on filter {{(pid=86222) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG cinder.image.image_utils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86222) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 16:59:47 devstack cinder-volume[86222]: INFO cinder.keymgr.migration [None req-7c167268-7ac0-4eb2-bc9f-910175b185e7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86222) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86222) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG cinder.volume.drivers.quobyte [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86222) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG cinder.volume.drivers.quobyte [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86222) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86222) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG oslo_concurrency.processutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:47 devstack sudo[86334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 16:59:47 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:47 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG oslo_concurrency.processutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.245s {{(pid=86222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG cinder.manager [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Notifying Schedulers of capabilities ... {{(pid=86222) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:59:47 devstack cinder-volume[86222]: INFO cinder.volume.manager [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Driver initialization completed successfully. Sep 28 16:59:47 devstack cinder-volume[86222]: INFO cinder.manager [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Initiating service 3 cleanup Sep 28 16:59:47 devstack cinder-volume[86222]: INFO cinder.manager [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Service 3 cleanup completed. Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG cinder.service [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Creating RPC server for service cinder-volume {{(pid=86222) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG cinder.service [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86222) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 16:59:47 devstack cinder-volume[86222]: INFO cinder.volume.manager [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86222) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86222) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG cinder.volume.drivers.quobyte [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86222) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG cinder.volume.drivers.quobyte [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86222) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86222) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG oslo_concurrency.processutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:47 devstack sudo[86337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 16:59:47 devstack sudo[86337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:47 devstack sudo[86337]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:47 devstack cinder-volume[86222]: DEBUG oslo_concurrency.processutils [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.270s {{(pid=86222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:47 devstack cinder-volume[86222]: INFO cinder.volume.manager [None req-43abf477-666f-4862-a563-8c5e6ad942bf None None] Driver post RPC initialization completed successfully. Sep 28 16:59:52 devstack cinder-volume[86003]: INFO oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Caught SIGTERM, stopping children Sep 28 16:59:52 devstack cinder-volume[86003]: DEBUG oslo_concurrency.lockutils [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Acquiring lock "singleton_lock" {{(pid=86003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:59:52 devstack cinder-volume[86003]: DEBUG oslo_concurrency.lockutils [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Acquired lock "singleton_lock" {{(pid=86003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:59:52 devstack cinder-volume[86003]: DEBUG oslo_concurrency.lockutils [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Releasing lock "singleton_lock" {{(pid=86003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:59:52 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Stop services. {{(pid=86003) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 16:59:52 devstack cinder-volume[86003]: DEBUG oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Killing children. {{(pid=86003) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 16:59:52 devstack cinder-volume[86003]: INFO oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Waiting on 1 children to exit Sep 28 16:59:55 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Acquiring lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:59:55 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Acquired lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:59:55 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Releasing lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:59:55 devstack cinder-volume[86222]: WARNING amqp [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 16:59:55 devstack cinder-volume[86222]: WARNING amqp [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 16:59:55 devstack cinder-volume[86003]: INFO oslo_service.backend._eventlet.service [None req-46ad7742-4bc7-40f5-bec0-0f3b13d214a1 None None] Child 86222 exited with status 0 Sep 28 16:59:56 devstack cinder-volume[86650]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 16:59:56 devstack cinder-volume[86650]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 16:59:56 devstack cinder-volume[86650]: we strongly recommend against using it for new projects. Sep 28 16:59:56 devstack cinder-volume[86650]: If you are already using Eventlet, we recommend migrating to a different Sep 28 16:59:56 devstack cinder-volume[86650]: framework. For more detail see Sep 28 16:59:56 devstack cinder-volume[86650]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 16:59:56 devstack cinder-volume[86650]: import eventlet # noqa Sep 28 16:59:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86650) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:59:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86650) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:59:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86650) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:00:00 devstack cinder-volume[86650]: INFO dbcounter [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] Registered counter for database cinder Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_db.sqlalchemy.engines [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86650) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writer thread running {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:00:00 devstack cinder-volume[86650]: INFO cinder.rpc [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:00:00 devstack cinder-volume[86650]: INFO cinder.rpc [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_db.sqlalchemy.engines [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86650) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:00 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] Determined volume DB was empty at startup. Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86650) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:00:00 devstack cinder-volume[86650]: WARNING stevedore.named [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:00:00 devstack cinder-volume[86650]: WARNING castellan.key_manager [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:00:00 devstack cinder-volume[86650]: WARNING cinder.keymgr.conf_key_mgr [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:00:00 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_db.sqlalchemy.engines [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86650) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:00 devstack cinder-volume[86650]: INFO oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] Starting 1 workers Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] Started child 86970 {{(pid=86650) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] Full set of CONF: {{(pid=86650) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] ******************************************************************************** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] Configuration options gathered from: {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] ================================================================================ {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] allow_availability_zone_fallback = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] allow_compression_on_image_upload = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] allowed_direct_url_schemes = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] api_rate_limit = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] auth_strategy = keystone {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_availability_zone = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_host = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_name = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_stats_polling_interval = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backup_api_class = cinder.backup.api.API {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backup_name_template = backup-%s {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backup_use_same_host = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backup_use_temp_snapshot = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86970]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] chap_password = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] chap_username = {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cinder_internal_tenant_project_id = 433c1a89af924a6785744487cae322c8 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cinder_internal_tenant_user_id = ab4da8ca41db474688cece56cae5ccb5 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cluster = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] compression_format = gzip {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] compute_api_class = cinder.compute.nova.API {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] config_dir = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] config_source = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] control_exchange = openstack {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] debug = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] default_availability_zone = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] default_group_type = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] default_volume_type = QuobyteHD {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] disk_geometry = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] driver_client_cert = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] driver_client_cert_key = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] driver_data_namespace = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] driver_ssl_cert_path = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] driver_ssl_cert_verify = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] driver_use_ssl = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] enable_new_services = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] enable_unsupported_driver = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] enabled_backends = ['QuobyteHD'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] enforce_multipath_for_image_xfer = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] filter_function = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance_api_insecure = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance_api_servers = ['http://192.168.122.16/image'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance_api_ssl_compression = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance_ca_certificates_file = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance_catalog_info = image:glance:publicURL {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance_certfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance_keyfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance_num_retries = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance_request_timeout = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] goodness_function = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] graceful_shutdown_timeout = 5 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] group_api_class = cinder.group.api.API {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] host = devstack {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] image_compress_on_upload = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] image_conversion_address_space_limit = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] image_conversion_cpu_limit = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] image_conversion_disable = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] image_introspection_address_space_limit = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] image_introspection_cpu_limit = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] image_upload_use_cinder_backend = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] image_upload_use_internal_tenant = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] image_volume_cache_enabled = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] image_volume_cache_max_count = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] image_volume_cache_max_size_gb = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] init_host_max_objects_retrieval = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] instance_format = [instance: %(uuid)s] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] iscsi_target_flags = {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] iscsi_write_cache = on {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] iser_helper = tgtadm {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] iser_ip_address = 192.168.122.16 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] iser_port = 3260 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] log_color = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] log_config_append = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] log_dir = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] log_file = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] log_options = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] log_rotate_interval = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] log_rotate_interval_type = days {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] log_rotation_type = none {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] max_age = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] max_logfile_count = 30 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] max_logfile_size_mb = 200 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] max_over_subscription_ratio = 20.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] message_reap_interval = 86400 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] message_ttl = 2592000 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] migration_create_volume_timeout_secs = 300 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] monkey_patch = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] monkey_patch_modules = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] my_ip = 192.168.122.16 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] no_snapshot_gb_quota = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] num_iser_scan_tries = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] num_shell_tries = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] num_volume_device_scan_tries = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] nvmeof_conn_info_version = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] nvmet_ns_id = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] nvmet_port_id = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] osapi_max_limit = 1000 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] osapi_volume_ext_list = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] osapi_volume_listen = 0.0.0.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] osapi_volume_listen_port = 8776 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] osapi_volume_use_ssl = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] osapi_volume_workers = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] per_volume_size_limit = -1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] periodic_fuzzy_delay = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] periodic_interval = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] project_id_regex = [0-9a-f\-]+ {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] public_endpoint = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] publish_errors = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] quota_backup_gigabytes = 1000 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] quota_backups = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] quota_gigabytes = 1000 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] quota_groups = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] quota_snapshots = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] quota_volumes = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] rate_limit_burst = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] rate_limit_except_level = CRITICAL {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] rate_limit_interval = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] reinit_driver_count = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] replication_device = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] report_discard_supported = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] report_interval = 120 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86970) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] reservation_clean_interval = 86400 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] reservation_expire = 86400 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] reserved_image_namespaces = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] reserved_percentage = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] rpc_response_timeout = 120 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] run_external_periodic_tasks = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] scst_target_driver = iscsi {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] scst_target_iqn_name = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] service_down_time = 720 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] shell_completion = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] snapshot_name_template = snapshot-%s {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] split_loggers = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] state_path = /opt/stack/data/cinder {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] storage_availability_zone = nova {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] storage_protocol = iSCSI {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] syslog_log_facility = LOG_USER {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] target_helper = lioadm {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] target_ip_address = 192.168.122.16 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] target_port = 3260 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] target_protocol = iscsi {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] target_secondary_ip_addresses = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] trace_flags = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] transfer_api_class = cinder.transfer.api.API {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] transport_url = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] until_refresh = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] use_chap_auth = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] use_default_quota_class = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] use_journal = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] use_json = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] use_multipath_for_image_xfer = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] use_stderr = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] use_syslog = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] verify_glance_signatures = enabled {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] volume_api_class = cinder.volume.api.API {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] volume_backend_name = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] volume_clear = zero {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] volume_clear_ionice = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] volume_clear_size = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] volume_copy_bps_limit = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] volume_dd_blocksize = 1M {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] volume_name_template = volume-%s {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] volume_service_inithost_offload = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] volume_usage_audit_period = month {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] zoning_mode = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_concurrency.disable_process_locking = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.auth_section = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.auth_type = password {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.auth_version = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.cache = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.certfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.include_service_catalog = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.insecure = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.interface = public {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.keyfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.memcache_password = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.memcache_username = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.region_name = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.service_type = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.16/identity {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.backend = dogpile.cache.null {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.backend_argument = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.backend_expiration_time = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.config_prefix = cache.oslo {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.debug_cache_backend = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.enable_retry_client = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.enable_socket_keepalive = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.enabled = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.expiration_time = 600 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.hashclient_retry_attempts = 2 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.memcache_dead_retry = 300 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.memcache_pool_maxsize = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.memcache_sasl_enabled = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.password = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.proxies = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.redis_db = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.redis_server = localhost:6379 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.retry_attempts = 2 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.retry_delay = 0.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.socket_keepalive_count = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.socket_keepalive_idle = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.socket_keepalive_interval = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.socket_timeout = 1.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.tls_allowed_ciphers = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.tls_cafile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.tls_certfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.tls_enabled = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.tls_keyfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cache.username = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] coordination.backend_url = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.asyncio_connection = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.asyncio_slave_connection = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.backend = sqlalchemy {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.connection = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.connection_debug = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.connection_parameters = {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.connection_recycle_time = 3600 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.connection_trace = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86970) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.db_inc_retry_interval = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.db_max_retries = 20 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.db_max_retry_interval = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.db_retry_interval = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.max_overflow = 50 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.max_pool_size = 5 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.max_retries = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.mysql_wsrep_sync_wait = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.pool_timeout = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.retry_interval = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.slave_connection = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.sqlite_synchronous = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.synchronous_reader = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] database.use_db_reconnect = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_tracing.insecure = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] profiler.connection_string = messaging:// {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] profiler.enabled = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] profiler.es_doc_type = notification {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] profiler.es_scroll_size = 10000 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] profiler.es_scroll_time = 2m {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] profiler.filter_error_trace = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] profiler.hmac_keys = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] profiler.sentinel_service_name = mymaster {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] profiler.socket_timeout = 0.1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] profiler.trace_requests = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] profiler.trace_sqlalchemy = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.quobyte [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] profiler_jaeger.process_tags = {} {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] profiler_jaeger.service_name_prefix = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] profiler_otlp.service_name_prefix = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_policy.enforce_new_defaults = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_policy.policy_default_rule = default {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.quobyte [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_policy.policy_file = policy.yaml {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_policy.remote_timeout = 60.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Running cmd (subprocess): mount.quobyte {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] privsep_osbrick.group = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] privsep_osbrick.helper_command = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] privsep_osbrick.user = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cinder_sys_admin.group = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cinder_sys_admin.helper_command = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] cinder_sys_admin.user = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] service_user.auth_section = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] service_user.auth_type = password {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] service_user.cafile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] service_user.certfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] service_user.collect_timing = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] service_user.insecure = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] service_user.keyfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] service_user.send_service_user_token = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] service_user.split_loggers = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] service_user.timeout = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] service_user.tls_ciphers = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] service_user.tls_min_version = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance.auth_section = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance.auth_type = password {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance.certfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance.collect_timing = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance.insecure = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance.keyfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance.region_name = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance.split_loggers = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance.timeout = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance.tls_ciphers = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] glance.tls_min_version = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.backend_availability_zone = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.chap_password = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.chap_username = {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.disk_geometry = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.driver_client_cert = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.driver_client_cert_key = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.driver_data_namespace = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.driver_use_ssl = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.extra_capabilities = {} {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.filter_function = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.goodness_function = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.iscsi_target_flags = {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.iscsi_write_cache = on {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.iser_helper = tgtadm {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.iser_ip_address = 192.168.122.16 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.iser_port = 3260 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.nas_host = {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.nas_login = admin {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.nas_mount_options = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.nas_password = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.nas_private_key = {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.nas_share_path = {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.nas_ssh_port = 22 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.num_shell_tries = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.quobyte_volume_url = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.replication_device = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.report_discard_supported = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.reserved_percentage = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.target_helper = tgtadm {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.target_ip_address = 192.168.122.16 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.target_port = 3260 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.target_protocol = iscsi {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.trace_flags = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.unique_fqdn_network = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.use_chap_auth = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.volume_backend_name = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.volume_clear = zero {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.volume_clear_ionice = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.volume_clear_size = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_reports.file_event_handler = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_reports.log_dir = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.backend_availability_zone = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.backend_host = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.chap_password = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.chap_username = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.chiscsi_conf = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.disk_geometry = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.driver_client_cert = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.driver_data_namespace = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.driver_use_ssl = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.extra_capabilities = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.filter_function = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.goodness_function = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.iscsi_target_flags = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.iscsi_write_cache = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.iser_helper = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.iser_ip_address = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.iser_port = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.iser_target_prefix = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.nas_host = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.nas_login = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack quobyte-client[86971]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.nas_mount_options = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.nas_password = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.nas_private_key = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack quobyte-client[86971]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.nas_share_path = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.nas_ssh_port = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.num_shell_tries = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.nvmet_ns_id = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.nvmet_port_id = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.replication_device = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.report_discard_supported = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.reserved_percentage = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.scst_target_driver = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.storage_protocol = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.target_helper = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.target_ip_address = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.target_port = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.target_prefix = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.target_protocol = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.trace_flags = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] CMD "mount.quobyte" returned: 1 in 0.077s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.unique_fqdn_network = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.use_chap_auth = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.volume_clear = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.volume_clear_ionice = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.volume_clear_size = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] QuobyteHD.volumes_dir = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:00 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.ssl = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.ssl_version = {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_notifications.driver = [] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_notifications.retry = -1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] key_manager.fixed_key = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.barbican_api_version = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.barbican_endpoint = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.barbican_endpoint_type = public {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.barbican_region_name = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.cafile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.certfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.collect_timing = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.insecure = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.keyfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.number_of_retries = 60 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.retry_delay = 1 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.send_service_user_token = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.split_loggers = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.timeout = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.tls_ciphers = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.tls_min_version = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.verify_ssl = True {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican.verify_ssl_path = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican_service_user.auth_section = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican_service_user.auth_type = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican_service_user.cafile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican_service_user.certfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican_service_user.collect_timing = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican_service_user.insecure = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican_service_user.keyfile = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican_service_user.split_loggers = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican_service_user.timeout = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican_service_user.tls_ciphers = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] barbican_service_user.tls_min_version = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] vault.approle_role_id = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] vault.approle_secret_id = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] vault.auth_method = approle {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] vault.auth_path = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] vault.kv_mountpoint = secret {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] vault.kv_path = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] vault.kv_version = 2 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] vault.namespace = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] vault.root_token_id = **** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] vault.ssl_ca_crt_file = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] vault.timeout = 60.0 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] vault.token_file = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] vault.token_role = None {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] vault.use_ssl = False {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86650]: DEBUG oslo_service.backend._eventlet.service [None req-ac768f3c-75aa-4f84-88b7-54c4d055416a None None] ******************************************************************************** {{(pid=86650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:00:01 devstack sudo[86972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:00:01 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:01 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.243s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:01 devstack cinder-volume[86970]: INFO cinder.volume.driver [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG cinder.volume.driver [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.153060913086, 'free_capacity_gb': 1775.153060913086, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86970) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG oslo_db.sqlalchemy.engines [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86970) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writer thread running {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG cinder.db.api [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Building query based on filter {{(pid=86970) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86970) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:01 devstack cinder-volume[86970]: INFO cinder.keymgr.migration [None req-86d30e15-2414-4a3e-a800-f61680b013a2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:00:01 devstack sudo[86984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:00:01 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:01 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.234s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:00:01 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Driver initialization completed successfully. Sep 28 17:00:01 devstack cinder-volume[86970]: INFO cinder.manager [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Initiating service 3 cleanup Sep 28 17:00:01 devstack cinder-volume[86970]: INFO cinder.manager [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Service 3 cleanup completed. Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG cinder.service [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Creating RPC server for service cinder-volume {{(pid=86970) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG cinder.service [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86970) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:00:01 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:00:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:01 devstack sudo[86996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:00:01 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:02 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.262s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:02 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-77f4093a-699d-4414-876a-6c85fbdc15d6 None None] Driver post RPC initialization completed successfully. Sep 28 17:00:10 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:00:11 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:00:12 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=3 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Flow 'volume_create_manager' (a6b1f11c-e34f-471b-ab83-6f4f0c500913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bac2434-3494-48c2-9746-4834d089fa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bac2434-3494-48c2-9746-4834d089fa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-78604783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=289fb1fa-0981-4800-bd4a-dbd6fd20a40f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d3bb40e0a84a85bf544539c3b54c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:00:59Z,use_quota=True,user_id='ba3ec6d0cdc8481891a9636cf508746c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8e2d1d-6e54-4a0c-aa8d-933c201f6eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8e2d1d-6e54-4a0c-aa8d-933c201f6eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2085e6-6210-4e58-ade8-591feaa8af4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2085e6-6210-4e58-ade8-591feaa8af4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '289fb1fa-0981-4800-bd4a-dbd6fd20a40f', 'volume_name': 'volume-289fb1fa-0981-4800-bd4a-dbd6fd20a40f', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0439171b-68c1-4c0e-ac26-22bf4209fad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0439171b-68c1-4c0e-ac26-22bf4209fad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5415ccc-4dde-4708-9a0e-c9642a4bd1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:00:59 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Volume 289fb1fa-0981-4800-bd4a-dbd6fd20a40f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-289fb1fa-0981-4800-bd4a-dbd6fd20a40f', 'volume_size': 1} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-78604783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=289fb1fa-0981-4800-bd4a-dbd6fd20a40f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d3bb40e0a84a85bf544539c3b54c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:00:59Z,use_quota=True,user_id='ba3ec6d0cdc8481891a9636cf508746c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Creating volume 289fb1fa-0981-4800-bd4a-dbd6fd20a40f {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:00:59 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:00:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-289fb1fa-0981-4800-bd4a-dbd6fd20a40f 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:59 devstack sudo[87389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-289fb1fa-0981-4800-bd4a-dbd6fd20a40f 1073741824 Sep 28 17:00:59 devstack sudo[87389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:00 devstack sudo[87389]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-289fb1fa-0981-4800-bd4a-dbd6fd20a40f 1073741824" returned: 0 in 0.993s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-289fb1fa-0981-4800-bd4a-dbd6fd20a40f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:00 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-289fb1fa-0981-4800-bd4a-dbd6fd20a40f Sep 28 17:01:00 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:01 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-289fb1fa-0981-4800-bd4a-dbd6fd20a40f" returned: 0 in 0.517s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5415ccc-4dde-4708-9a0e-c9642a4bd1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-289fb1fa-0981-4800-bd4a-dbd6fd20a40f', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3584f7-840b-4970-9fc1-58c78874f86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:01 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Volume volume-289fb1fa-0981-4800-bd4a-dbd6fd20a40f (289fb1fa-0981-4800-bd4a-dbd6fd20a40f): created successfully Sep 28 17:01:01 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:01:01 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3584f7-840b-4970-9fc1-58c78874f86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Flow 'volume_create_manager' (a6b1f11c-e34f-471b-ab83-6f4f0c500913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:01:01 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-959a8ff0-8eb9-43b2-bb72-2479ca76f240 tempest-TaggedAttachmentsTest-235057520 None] Created volume successfully. Sep 28 17:01:01 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.381s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 6 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:01:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Flow 'volume_create_manager' (f031ac5a-e258-431b-b00d-eb7764780c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b192e60-dfaa-4538-8881-8effc2bbd02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b192e60-dfaa-4538-8881-8effc2bbd02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1404358513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b97380d-e5da-46d1-90c7-eac06c948b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfe8784cb0340668fd293bcdce4a340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:01:06Z,use_quota=True,user_id='f218d689eb3f43b6bbe651b63e2bc81c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c17b89-53ed-421b-b464-87a5106292d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c17b89-53ed-421b-b464-87a5106292d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f12773a-79f6-4348-93dc-6e0650913a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f12773a-79f6-4348-93dc-6e0650913a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b97380d-e5da-46d1-90c7-eac06c948b30', 'volume_name': 'volume-1b97380d-e5da-46d1-90c7-eac06c948b30', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c9db1a-748f-4278-a3bc-0f1d549d7302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c9db1a-748f-4278-a3bc-0f1d549d7302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431c92e5-b87f-4965-8013-5e2feff6d30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:06 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Volume 1b97380d-e5da-46d1-90c7-eac06c948b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b97380d-e5da-46d1-90c7-eac06c948b30', 'volume_size': 1} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1404358513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b97380d-e5da-46d1-90c7-eac06c948b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfe8784cb0340668fd293bcdce4a340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:01:06Z,use_quota=True,user_id='f218d689eb3f43b6bbe651b63e2bc81c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Creating volume 1b97380d-e5da-46d1-90c7-eac06c948b30 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:01:06 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:01:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1b97380d-e5da-46d1-90c7-eac06c948b30 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:06 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1b97380d-e5da-46d1-90c7-eac06c948b30 1073741824 Sep 28 17:01:06 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:08 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1b97380d-e5da-46d1-90c7-eac06c948b30 1073741824" returned: 0 in 1.811s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1b97380d-e5da-46d1-90c7-eac06c948b30 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:08 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1b97380d-e5da-46d1-90c7-eac06c948b30 Sep 28 17:01:08 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:08 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1b97380d-e5da-46d1-90c7-eac06c948b30" returned: 0 in 0.459s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] <== create_volume: return (2401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:01:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.407s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:01:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431c92e5-b87f-4965-8013-5e2feff6d30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b97380d-e5da-46d1-90c7-eac06c948b30', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21eddaa-31df-49bb-8d7c-f0ca873634a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:09 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Volume volume-1b97380d-e5da-46d1-90c7-eac06c948b30 (1b97380d-e5da-46d1-90c7-eac06c948b30): created successfully Sep 28 17:01:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21eddaa-31df-49bb-8d7c-f0ca873634a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Flow 'volume_create_manager' (f031ac5a-e258-431b-b00d-eb7764780c8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:01:09 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-550f0165-d747-4b66-a1dc-aa3baa4bbeaa tempest-DeleteServersTestJSON-1003743782 None] Created volume successfully. Sep 28 17:01:14 devstack cinder-volume[86970]: WARNING py.warnings [req-25f09c0f-01cf-42b9-94bd-7406dd1c9e21 req-b5b4d632-3056-4586-b097-3fcffde5ed0f tempest-DeleteServersTestJSON-1003743782 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 28 17:01:14 devstack cinder-volume[86970]: .first() Sep 28 17:01:14 devstack cinder-volume[86970]: Sep 28 17:01:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-25f09c0f-01cf-42b9-94bd-7406dd1c9e21 req-b5b4d632-3056-4586-b097-3fcffde5ed0f tempest-DeleteServersTestJSON-1003743782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:01:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-25f09c0f-01cf-42b9-94bd-7406dd1c9e21 req-b5b4d632-3056-4586-b097-3fcffde5ed0f tempest-DeleteServersTestJSON-1003743782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:01:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-25f09c0f-01cf-42b9-94bd-7406dd1c9e21 req-b5b4d632-3056-4586-b097-3fcffde5ed0f tempest-DeleteServersTestJSON-1003743782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:01:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-25f09c0f-01cf-42b9-94bd-7406dd1c9e21 req-b5b4d632-3056-4586-b097-3fcffde5ed0f tempest-DeleteServersTestJSON-1003743782 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-1b97380d-e5da-46d1-90c7-eac06c948b30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '094ecec1-2b47-449e-b443-181be8b76936', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:01:15 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-25f09c0f-01cf-42b9-94bd-7406dd1c9e21 req-b5b4d632-3056-4586-b097-3fcffde5ed0f tempest-DeleteServersTestJSON-1003743782 None] attachment_update completed successfully. Sep 28 17:01:20 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-b64796ee-b47a-42ef-b12e-f574ef16109c req-f3775c06-d68b-4c13-87f9-cb3f6934f2be tempest-DeleteServersTestJSON-1003743782 None] Terminate volume connection completed successfully. Sep 28 17:01:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-b64796ee-b47a-42ef-b12e-f574ef16109c req-f3775c06-d68b-4c13-87f9-cb3f6934f2be tempest-DeleteServersTestJSON-1003743782 None] Deleting attachment 094ecec1-2b47-449e-b443-181be8b76936. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:01:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Acquiring lock "cinder-1b97380d-e5da-46d1-90c7-eac06c948b30-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:01:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Lock "cinder-1b97380d-e5da-46d1-90c7-eac06c948b30-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:01:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Acquiring lock "cinder-quobyte-1b97380d-e5da-46d1-90c7-eac06c948b30" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:01:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Lock "cinder-quobyte-1b97380d-e5da-46d1-90c7-eac06c948b30" acquired by "delete_volume" :: waited 0.028s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:01:22 devstack cinder-volume[86970]: INFO oslo.privsep.daemon [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp10vxwb42/privsep.sock'] Sep 28 17:01:22 devstack sudo[88450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp10vxwb42/privsep.sock Sep 28 17:01:22 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:23 devstack cinder-volume[86970]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 17:01:23 devstack cinder-volume[86970]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:01:23 devstack cinder-volume[86970]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 17:01:23 devstack cinder-volume[86970]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 17:01:23 devstack cinder-volume[86970]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:01:23 devstack cinder-volume[86970]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 17:01:23 devstack cinder-volume[86970]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:01:23 devstack cinder-volume[86970]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 17:01:23 devstack cinder-volume[86970]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 17:01:24 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:24 devstack cinder-volume[86970]: INFO oslo.privsep.daemon [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Spawned new privsep daemon via rootwrap Sep 28 17:01:24 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Accepted privsep connection to /tmp/tmp10vxwb42/privsep.sock {{(pid=86970) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 17:01:24 devstack cinder-volume[86970]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 17:01:24 devstack cinder-volume[86970]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 17:01:24 devstack cinder-volume[86970]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 17:01:24 devstack cinder-volume[86970]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88482 Sep 28 17:01:24 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc5245c-ab3b-4f31-8445-1476c90db3cc]: (2,) {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:01:24 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[2536af68-3bc9-4201-95aa-c394ae8a09aa]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:01:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1b97380d-e5da-46d1-90c7-eac06c948b30 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:24 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1b97380d-e5da-46d1-90c7-eac06c948b30 Sep 28 17:01:24 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:24 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1b97380d-e5da-46d1-90c7-eac06c948b30" returned: 0 in 0.583s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1b97380d-e5da-46d1-90c7-eac06c948b30 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:24 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1b97380d-e5da-46d1-90c7-eac06c948b30 Sep 28 17:01:24 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:25 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1b97380d-e5da-46d1-90c7-eac06c948b30" returned: 0 in 0.464s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:25 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Lock "cinder-quobyte-1b97380d-e5da-46d1-90c7-eac06c948b30" released by "delete_volume" :: held 2.716s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:01:25 devstack cinder-volume[86970]: WARNING cinder.quota [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:01:25 devstack cinder-volume[86970]: WARNING cinder.quota [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:01:25 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Created reservations ['b8846ecd-5f65-458f-9c13-efb1dc4e8005', '422f7b10-9a31-490d-9c5d-b943cfd44077', 'ed090d90-ec4b-4675-964e-afb8be2145ee', '9e429e2e-d8f9-4da2-b5ce-af20f1e2c4d3'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:01:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:01:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:01:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:01:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:01:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:01:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:25 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:01:25 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:26 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.366s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:26 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:01:26 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Deleted volume successfully. Sep 28 17:01:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-68dc9ccd-8dc4-42fb-80bf-8c0eb76afa1b tempest-DeleteServersTestJSON-1003743782 None] Lock "cinder-1b97380d-e5da-46d1-90c7-eac06c948b30-delete_volume" released by "delete_volume" :: held 3.553s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:01:35 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=16,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:01:36 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:UPDATE=12,cinder:SELECT=17,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:01:37 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:01:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Flow 'volume_create_manager' (3d957eb7-f542-418b-9444-ff7dd7b9c553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b31b70-7046-4311-b45a-797345aadc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b31b70-7046-4311-b45a-797345aadc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1788967107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d078197-f41d-4555-9167-c947af8549a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9e61f305713464bbe87d1f278542b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:01:38Z,use_quota=True,user_id='d4f49cae3b1c4ce4ac3e83b7d028fe79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae356e11-8798-4c83-a654-637bcca204c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae356e11-8798-4c83-a654-637bcca204c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6ede4e-8422-4005-bb67-605efa9154a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6ede4e-8422-4005-bb67-605efa9154a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d078197-f41d-4555-9167-c947af8549a0', 'volume_name': 'volume-6d078197-f41d-4555-9167-c947af8549a0', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24873fba-3a5b-4292-92a2-31b8bf146f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24873fba-3a5b-4292-92a2-31b8bf146f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe45ad5-30fb-4fbf-85a8-19728af74e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:38 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Volume 6d078197-f41d-4555-9167-c947af8549a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d078197-f41d-4555-9167-c947af8549a0', 'volume_size': 1} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1788967107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d078197-f41d-4555-9167-c947af8549a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9e61f305713464bbe87d1f278542b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:01:38Z,use_quota=True,user_id='d4f49cae3b1c4ce4ac3e83b7d028fe79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Creating volume 6d078197-f41d-4555-9167-c947af8549a0 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:01:38 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6d078197-f41d-4555-9167-c947af8549a0 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:38 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6d078197-f41d-4555-9167-c947af8549a0 1073741824 Sep 28 17:01:38 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:38 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6d078197-f41d-4555-9167-c947af8549a0 1073741824" returned: 0 in 0.759s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6d078197-f41d-4555-9167-c947af8549a0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:38 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6d078197-f41d-4555-9167-c947af8549a0 Sep 28 17:01:38 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:39 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6d078197-f41d-4555-9167-c947af8549a0" returned: 0 in 0.389s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:01:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:01:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe45ad5-30fb-4fbf-85a8-19728af74e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d078197-f41d-4555-9167-c947af8549a0', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e131b618-6987-4259-9845-e20bd6158d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:39 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Volume volume-6d078197-f41d-4555-9167-c947af8549a0 (6d078197-f41d-4555-9167-c947af8549a0): created successfully Sep 28 17:01:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e131b618-6987-4259-9845-e20bd6158d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Flow 'volume_create_manager' (3d957eb7-f542-418b-9444-ff7dd7b9c553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:01:39 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-03f2bf6a-940b-483e-bdc9-f76386d44006 tempest-ServerActionsTestOtherA-871510388 None] Created volume successfully. Sep 28 17:01:49 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:01:49 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:02:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:02:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:01 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:02:01 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:01 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.313s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:02:12 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:02:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-48353722-4ecb-472b-9967-e1d78fa4ef2d req-c38a10bb-464d-40ad-944d-bacc6edc0f18 tempest-TaggedAttachmentsTest-235057520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-48353722-4ecb-472b-9967-e1d78fa4ef2d req-c38a10bb-464d-40ad-944d-bacc6edc0f18 tempest-TaggedAttachmentsTest-235057520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-48353722-4ecb-472b-9967-e1d78fa4ef2d req-c38a10bb-464d-40ad-944d-bacc6edc0f18 tempest-TaggedAttachmentsTest-235057520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-48353722-4ecb-472b-9967-e1d78fa4ef2d req-c38a10bb-464d-40ad-944d-bacc6edc0f18 tempest-TaggedAttachmentsTest-235057520 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-289fb1fa-0981-4800-bd4a-dbd6fd20a40f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8343456d-1a73-43f3-a3f6-036185cf3137', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:02:12 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-48353722-4ecb-472b-9967-e1d78fa4ef2d req-c38a10bb-464d-40ad-944d-bacc6edc0f18 tempest-TaggedAttachmentsTest-235057520 None] attachment_update completed successfully. Sep 28 17:02:18 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-f5d8ae91-8ac6-4b2a-b09b-367f6cd79602 req-0e1a97bd-c3f0-4609-8ee2-d3a621ce0669 tempest-TaggedAttachmentsTest-235057520 None] Terminate volume connection completed successfully. Sep 28 17:02:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-f5d8ae91-8ac6-4b2a-b09b-367f6cd79602 req-0e1a97bd-c3f0-4609-8ee2-d3a621ce0669 tempest-TaggedAttachmentsTest-235057520 None] Deleting attachment 8343456d-1a73-43f3-a3f6-036185cf3137. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:02:28 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:02:28 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:02:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-e8ceec37-02f8-4bf7-82bd-1b42bec63038 req-5319c2ee-a98b-4498-abd6-46b68758c87d tempest-ServerActionsTestOtherA-871510388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-e8ceec37-02f8-4bf7-82bd-1b42bec63038 req-5319c2ee-a98b-4498-abd6-46b68758c87d tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-e8ceec37-02f8-4bf7-82bd-1b42bec63038 req-5319c2ee-a98b-4498-abd6-46b68758c87d tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-e8ceec37-02f8-4bf7-82bd-1b42bec63038 req-5319c2ee-a98b-4498-abd6-46b68758c87d tempest-ServerActionsTestOtherA-871510388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-6d078197-f41d-4555-9167-c947af8549a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f44d705f-96aa-415f-bd86-0298056c05a2', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:02:34 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-e8ceec37-02f8-4bf7-82bd-1b42bec63038 req-5319c2ee-a98b-4498-abd6-46b68758c87d tempest-ServerActionsTestOtherA-871510388 None] attachment_update completed successfully. Sep 28 17:02:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] Acquiring lock "cinder-289fb1fa-0981-4800-bd4a-dbd6fd20a40f-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:02:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] Lock "cinder-289fb1fa-0981-4800-bd4a-dbd6fd20a40f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:02:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] Acquiring lock "cinder-quobyte-289fb1fa-0981-4800-bd4a-dbd6fd20a40f" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:02:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] Lock "cinder-quobyte-289fb1fa-0981-4800-bd4a-dbd6fd20a40f" acquired by "delete_volume" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:02:35 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c256b44-04ff-424c-b034-a32e0efcc037]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:02:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-289fb1fa-0981-4800-bd4a-dbd6fd20a40f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:35 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-289fb1fa-0981-4800-bd4a-dbd6fd20a40f Sep 28 17:02:35 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:36 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-289fb1fa-0981-4800-bd4a-dbd6fd20a40f" returned: 0 in 0.699s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-289fb1fa-0981-4800-bd4a-dbd6fd20a40f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:36 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-289fb1fa-0981-4800-bd4a-dbd6fd20a40f Sep 28 17:02:36 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Flow 'volume_create_manager' (3804cb48-4bf6-4f02-9e82-7b8b2ef5e700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5609239-bbd1-4580-9fd6-a8264b3de425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5609239-bbd1-4580-9fd6-a8264b3de425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1717523886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff8ce22-b155-44c8-945d-861254799923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00abc2170f044ac7bd67a0946259b750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:02:36Z,use_quota=True,user_id='db9fecdc6dd14d84ac6af9d62dcb4bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba39b204-7faf-4ef2-9b72-ff47fb782921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba39b204-7faf-4ef2-9b72-ff47fb782921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:36 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a44428-ed7c-4921-8a96-9e931e4ded3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a44428-ed7c-4921-8a96-9e931e4ded3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff8ce22-b155-44c8-945d-861254799923', 'volume_name': 'volume-cff8ce22-b155-44c8-945d-861254799923', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd459ca-dbd0-4ee6-9f87-3738070cd240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd459ca-dbd0-4ee6-9f87-3738070cd240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4881aa88-4864-4aeb-acf2-3997591c7503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:36 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Volume cff8ce22-b155-44c8-945d-861254799923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff8ce22-b155-44c8-945d-861254799923', 'volume_size': 1} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1717523886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff8ce22-b155-44c8-945d-861254799923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00abc2170f044ac7bd67a0946259b750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:02:36Z,use_quota=True,user_id='db9fecdc6dd14d84ac6af9d62dcb4bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Creating volume cff8ce22-b155-44c8-945d-861254799923 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:02:36 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cff8ce22-b155-44c8-945d-861254799923 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-289fb1fa-0981-4800-bd4a-dbd6fd20a40f" returned: 0 in 0.504s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:36 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cff8ce22-b155-44c8-945d-861254799923 1073741824 Sep 28 17:02:36 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] Lock "cinder-quobyte-289fb1fa-0981-4800-bd4a-dbd6fd20a40f" released by "delete_volume" :: held 1.305s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] Created reservations ['d49c5e90-79db-4e41-b72a-3be711bf3c9c', 'fb024ce6-bbb9-40c7-9590-4a768b124bbf', '2d8b8696-d7af-4a35-b166-255c8331db34', '1b15a2ab-29f6-4f47-9a45-780a40c35f8f'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:36 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:02:36 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:37 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.477s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:37 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:02:37 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] Deleted volume successfully. Sep 28 17:02:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-22e51664-3971-4756-9f3f-4b77c7fac15a tempest-TaggedAttachmentsTest-235057520 None] Lock "cinder-289fb1fa-0981-4800-bd4a-dbd6fd20a40f-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:02:37 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cff8ce22-b155-44c8-945d-861254799923 1073741824" returned: 0 in 0.848s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cff8ce22-b155-44c8-945d-861254799923 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:37 devstack sudo[90029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cff8ce22-b155-44c8-945d-861254799923 Sep 28 17:02:37 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:37 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cff8ce22-b155-44c8-945d-861254799923" returned: 0 in 0.430s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:02:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4881aa88-4864-4aeb-acf2-3997591c7503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff8ce22-b155-44c8-945d-861254799923', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af8cd76-bb14-4966-bf01-418920ad390d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:37 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Volume volume-cff8ce22-b155-44c8-945d-861254799923 (cff8ce22-b155-44c8-945d-861254799923): created successfully Sep 28 17:02:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af8cd76-bb14-4966-bf01-418920ad390d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Flow 'volume_create_manager' (3804cb48-4bf6-4f02-9e82-7b8b2ef5e700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:02:37 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0bfee141-9127-4c20-9964-dede4bb519a7 tempest-AttachVolumeShelveTestJSON-612947882 None] Created volume successfully. Sep 28 17:02:39 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-8e3ba2af-b1e4-496b-9065-d240fa34fb80 req-91247be1-e4a5-4412-bab7-319fbf011d17 tempest-ServerActionsTestOtherA-871510388 None] Terminate volume connection completed successfully. Sep 28 17:02:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-8e3ba2af-b1e4-496b-9065-d240fa34fb80 req-91247be1-e4a5-4412-bab7-319fbf011d17 tempest-ServerActionsTestOtherA-871510388 None] Deleting attachment f44d705f-96aa-415f-bd86-0298056c05a2. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:02:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-8e3ba2af-b1e4-496b-9065-d240fa34fb80 req-83220727-8118-44a2-b4bb-42a1c2d273de tempest-ServerActionsTestOtherA-871510388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-8e3ba2af-b1e4-496b-9065-d240fa34fb80 req-83220727-8118-44a2-b4bb-42a1c2d273de tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-8e3ba2af-b1e4-496b-9065-d240fa34fb80 req-83220727-8118-44a2-b4bb-42a1c2d273de tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-8e3ba2af-b1e4-496b-9065-d240fa34fb80 req-83220727-8118-44a2-b4bb-42a1c2d273de tempest-ServerActionsTestOtherA-871510388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-6d078197-f41d-4555-9167-c947af8549a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e398b55-6070-44fe-9a46-d6fab379d5dc', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:02:40 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-8e3ba2af-b1e4-496b-9065-d240fa34fb80 req-83220727-8118-44a2-b4bb-42a1c2d273de tempest-ServerActionsTestOtherA-871510388 None] attachment_update completed successfully. Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Flow 'volume_create_manager' (d06f702a-d894-42ce-9292-58aef9654af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb9ad25-2cb1-4b22-a07b-58d98816f0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb9ad25-2cb1-4b22-a07b-58d98816f0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1350330241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a55d84-24ee-4345-be06-f1a36984e987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd01e89141924bcabbab83d6a8bff23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:02:49Z,use_quota=True,user_id='2438483fb8c84ed38029a3a4fa383c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a4fc43-9a3c-490f-9944-3c993283c5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a4fc43-9a3c-490f-9944-3c993283c5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f3e907-adf9-49b9-b0d3-7c427ac26c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f3e907-adf9-49b9-b0d3-7c427ac26c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a55d84-24ee-4345-be06-f1a36984e987', 'volume_name': 'volume-b2a55d84-24ee-4345-be06-f1a36984e987', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8012d07-f12f-4cee-9e85-4d6c3fa06247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8012d07-f12f-4cee-9e85-4d6c3fa06247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec677a8-b3a3-4ec9-a96c-234a22cf9108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:49 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Volume b2a55d84-24ee-4345-be06-f1a36984e987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a55d84-24ee-4345-be06-f1a36984e987', 'volume_size': 1} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1350330241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a55d84-24ee-4345-be06-f1a36984e987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd01e89141924bcabbab83d6a8bff23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:02:49Z,use_quota=True,user_id='2438483fb8c84ed38029a3a4fa383c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Creating volume b2a55d84-24ee-4345-be06-f1a36984e987 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:02:49 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:02:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b2a55d84-24ee-4345-be06-f1a36984e987 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:49 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b2a55d84-24ee-4345-be06-f1a36984e987 1073741824 Sep 28 17:02:49 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:50 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b2a55d84-24ee-4345-be06-f1a36984e987 1073741824" returned: 0 in 1.262s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b2a55d84-24ee-4345-be06-f1a36984e987 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:50 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b2a55d84-24ee-4345-be06-f1a36984e987 Sep 28 17:02:50 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:51 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b2a55d84-24ee-4345-be06-f1a36984e987" returned: 0 in 0.517s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:02:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec677a8-b3a3-4ec9-a96c-234a22cf9108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a55d84-24ee-4345-be06-f1a36984e987', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6292ad32-98ef-48d9-9707-600be954a2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:51 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Volume volume-b2a55d84-24ee-4345-be06-f1a36984e987 (b2a55d84-24ee-4345-be06-f1a36984e987): created successfully Sep 28 17:02:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6292ad32-98ef-48d9-9707-600be954a2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Flow 'volume_create_manager' (d06f702a-d894-42ce-9292-58aef9654af2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:02:51 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-e8f3351e-fe3a-4130-954a-6161cf384142 tempest-VolumesAdminNegativeTest-1331310879 None] Created volume successfully. Sep 28 17:02:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] Acquiring lock "cinder-b2a55d84-24ee-4345-be06-f1a36984e987-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:02:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] Lock "cinder-b2a55d84-24ee-4345-be06-f1a36984e987-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:02:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] Acquiring lock "cinder-quobyte-b2a55d84-24ee-4345-be06-f1a36984e987" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:02:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] Lock "cinder-quobyte-b2a55d84-24ee-4345-be06-f1a36984e987" acquired by "delete_volume" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:02:53 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad457c5-72f8-4b90-83c1-9527e89c7131]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:02:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b2a55d84-24ee-4345-be06-f1a36984e987 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:53 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b2a55d84-24ee-4345-be06-f1a36984e987 Sep 28 17:02:53 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:54 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b2a55d84-24ee-4345-be06-f1a36984e987" returned: 0 in 1.024s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b2a55d84-24ee-4345-be06-f1a36984e987 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:54 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b2a55d84-24ee-4345-be06-f1a36984e987 Sep 28 17:02:54 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:55 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b2a55d84-24ee-4345-be06-f1a36984e987" returned: 0 in 0.450s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] Lock "cinder-quobyte-b2a55d84-24ee-4345-be06-f1a36984e987" released by "delete_volume" :: held 1.653s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:02:55 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] Created reservations ['fe57f3e5-afc9-4de0-8cd9-623b65366072', '82c87ea9-7da9-413a-b029-9ac93d2cb74f', 'fa42ef6a-4096-4f66-952a-94dd6f80c192', 'fa33c8ed-acca-45b9-a570-9e5986f375db'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:02:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:55 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:02:55 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:56 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.616s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:56 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:02:56 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] Deleted volume successfully. Sep 28 17:02:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8872dea9-b767-4a88-983b-98ac61b51c7b tempest-VolumesAdminNegativeTest-1331310879 None] Lock "cinder-b2a55d84-24ee-4345-be06-f1a36984e987-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:02:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-6f61d108-9b16-4577-b471-aa883961e82f req-d47e333a-6060-4e34-a7e6-d86d81982940 tempest-AttachVolumeShelveTestJSON-612947882 None] No connector for attachment 14797511-0a45-4e5d-b3ae-2942c3f64b65; skipping storage backend terminate_connection call. {{(pid=86970) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 17:02:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-6f61d108-9b16-4577-b471-aa883961e82f req-d47e333a-6060-4e34-a7e6-d86d81982940 tempest-AttachVolumeShelveTestJSON-612947882 None] Deleting attachment 14797511-0a45-4e5d-b3ae-2942c3f64b65. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:03:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:03:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 8 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:03:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:03:06 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=28,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:03:07 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=30,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:03:21 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-3df32dac-03f4-4ee8-8785-51f440520184 req-076544b4-0867-4446-9974-ee69f499dd98 tempest-ServerActionsTestOtherA-871510388 None] Terminate volume connection completed successfully. Sep 28 17:03:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-3df32dac-03f4-4ee8-8785-51f440520184 req-076544b4-0867-4446-9974-ee69f499dd98 tempest-ServerActionsTestOtherA-871510388 None] Deleting attachment 8e398b55-6070-44fe-9a46-d6fab379d5dc. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:03:31 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=1 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:03:31 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=1 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:03:35 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:03:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Flow 'volume_create_manager' (0b1e2df6-4aec-4d46-9bc6-676337a13169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:03:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56e91c7-34ba-4f6e-a8e2-05027b188dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56e91c7-34ba-4f6e-a8e2-05027b188dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-897059741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f71802f1-6d7e-4a08-be3b-631e9c5ccda2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9e61f305713464bbe87d1f278542b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:03:35Z,use_quota=True,user_id='d4f49cae3b1c4ce4ac3e83b7d028fe79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b62c3a-0c78-4a79-85f3-c7d310f38e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b62c3a-0c78-4a79-85f3-c7d310f38e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4efbd376-ccee-40ab-85c1-fcc11e9ffe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:35 devstack cinder-volume[86970]: DEBUG cinder.image.glance [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Creating Keystone auth plugin from conf {{(pid=86970) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:03:36 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4efbd376-ccee-40ab-85c1-fcc11e9ffe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f71802f1-6d7e-4a08-be3b-631e9c5ccda2', 'volume_name': 'volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2', 'volume_size': 1, 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '280d624e0a3d44539d88968c5a0e8318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:36 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82b102a-2858-4dbe-a254-da29240b2fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:36 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82b102a-2858-4dbe-a254-da29240b2fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:36 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cb0228-33a4-4197-b0f3-ea14f5cf0d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:36 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Volume f71802f1-6d7e-4a08-be3b-631e9c5ccda2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2', 'volume_size': 1, 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '280d624e0a3d44539d88968c5a0e8318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:03:36 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Trying to clone f71802f1-6d7e-4a08-be3b-631e9c5ccda2 from image d659fbbf-f540-415a-bb1b-8ef207a29f4e at location (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]). {{(pid=86970) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:03:37 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_rqd8sfd8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:03:37 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:03:37 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a1883c-c6f4-4b14-a381-d1174aee42a3]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:03:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_rqd8sfd8devstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:37 devstack sudo[91271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_rqd8sfd8devstack@QuobyteHD Sep 28 17:03:37 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:38 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_rqd8sfd8devstack@QuobyteHD" returned: 0 in 0.579s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:38 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Temporary image d659fbbf-f540-415a-bb1b-8ef207a29f4e is fetched for user d4f49cae3b1c4ce4ac3e83b7d028fe79. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:03:38 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[d418243b-f05a-4bae-8586-9c6279400b35]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:03:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_rqd8sfd8devstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:38 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_rqd8sfd8devstack@QuobyteHD Sep 28 17:03:38 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:38 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_rqd8sfd8devstack@QuobyteHD" returned: 0 in 0.598s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-897059741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f71802f1-6d7e-4a08-be3b-631e9c5ccda2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9e61f305713464bbe87d1f278542b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:03:35Z,use_quota=True,user_id='d4f49cae3b1c4ce4ac3e83b7d028fe79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:03:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Creating volume f71802f1-6d7e-4a08-be3b-631e9c5ccda2 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:03:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:03:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:03:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:03:38 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:03:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:38 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2 1073741824 Sep 28 17:03:38 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:39 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2 1073741824" returned: 0 in 0.948s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:39 devstack sudo[91303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2 Sep 28 17:03:39 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:40 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2" returned: 0 in 0.327s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:03:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:40 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Attempting download of d659fbbf-f540-415a-bb1b-8ef207a29f4e ((None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}])) to volume f71802f1-6d7e-4a08-be3b-631e9c5ccda2. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:03:40 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8f0fbe-df59-43ba-ae02-23f258d83d9b]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:03:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_vm4n1qpd {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:40 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_vm4n1qpd Sep 28 17:03:40 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:40 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_vm4n1qpd" returned: 0 in 0.492s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_vm4n1qpd {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:41 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_vm4n1qpd Sep 28 17:03:41 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:41 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_vm4n1qpd" returned: 1 in 0.641s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_vm4n1qpd' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:03:41 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a81bea1-0de0-4a36-a048-fa7aea1e96d1]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:03:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_rqd8sfd8devstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:41 devstack sudo[91315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_rqd8sfd8devstack@QuobyteHD Sep 28 17:03:41 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:42 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_rqd8sfd8devstack@QuobyteHD" returned: 0 in 0.999s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:42 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] d659fbbf-f540-415a-bb1b-8ef207a29f4e was qcow2, converting to qcow2 {{(pid=86970) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:03:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_rqd8sfd8devstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:42 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_rqd8sfd8devstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2 Sep 28 17:03:42 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:46 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_rqd8sfd8devstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2" returned: 0 in 4.249s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:46 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_rqd8sfd8devstack@QuobyteHD, size 112.00 MB, duration 4.25 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2 {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:03:46 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Converted 112.00 MB image at 26.35 MB/s Sep 28 17:03:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:46 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2 1G Sep 28 17:03:46 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:47 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2 1G" returned: 0 in 0.563s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:47 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Downloaded image d659fbbf-f540-415a-bb1b-8ef207a29f4e ((None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}])) to volume f71802f1-6d7e-4a08-be3b-631e9c5ccda2 successfully. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:03:47 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Temporary image d659fbbf-f540-415a-bb1b-8ef207a29f4e for user d4f49cae3b1c4ce4ac3e83b7d028fe79 is deleted. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:03:47 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Marking volume f71802f1-6d7e-4a08-be3b-631e9c5ccda2 as bootable. {{(pid=86970) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:03:47 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Copying metadata from image d659fbbf-f540-415a-bb1b-8ef207a29f4e to f71802f1-6d7e-4a08-be3b-631e9c5ccda2. {{(pid=86970) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:03:47 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Creating volume glance metadata for volume f71802f1-6d7e-4a08-be3b-631e9c5ccda2 backed by image d659fbbf-f540-415a-bb1b-8ef207a29f4e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86970) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:03:47 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cb0228-33a4-4197-b0f3-ea14f5cf0d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2', 'volume_size': 1, 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '280d624e0a3d44539d88968c5a0e8318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:47 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86172b8a-926a-4fda-8c05-91c9b67762f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:47 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Volume volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2 (f71802f1-6d7e-4a08-be3b-631e9c5ccda2): created successfully Sep 28 17:03:47 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86172b8a-926a-4fda-8c05-91c9b67762f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:47 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Flow 'volume_create_manager' (0b1e2df6-4aec-4d46-9bc6-676337a13169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:03:47 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ab8b6c00-5028-4638-8804-f49f4fa2315e tempest-ServerActionsTestOtherA-871510388 None] Created volume successfully. Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] Acquiring lock "cinder-cff8ce22-b155-44c8-945d-861254799923-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] Lock "cinder-cff8ce22-b155-44c8-945d-861254799923-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Flow 'volume_create_manager' (573e46b7-6c7f-4b43-baa8-91b03ac7b424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff24064f-c633-4c6d-9a73-146ccb18273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff24064f-c633-4c6d-9a73-146ccb18273c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1372686312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9da3f2-2768-4090-92d2-200d831b84a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='463e92b996b149fea9a4da8b97c11d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:03:54Z,use_quota=True,user_id='192faf0cee914ceab5c39ee3b15a5fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b28875-b29e-4da7-957c-385498f0dbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b28875-b29e-4da7-957c-385498f0dbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3153a267-a056-4873-9871-949bebdcd6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3153a267-a056-4873-9871-949bebdcd6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd9da3f2-2768-4090-92d2-200d831b84a0', 'volume_name': 'volume-dd9da3f2-2768-4090-92d2-200d831b84a0', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd83c0c-d026-44b0-b292-e05e754ab5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd83c0c-d026-44b0-b292-e05e754ab5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d6018c-fa50-467b-afbe-828325073067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:54 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Volume dd9da3f2-2768-4090-92d2-200d831b84a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd9da3f2-2768-4090-92d2-200d831b84a0', 'volume_size': 1} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1372686312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9da3f2-2768-4090-92d2-200d831b84a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='463e92b996b149fea9a4da8b97c11d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:03:54Z,use_quota=True,user_id='192faf0cee914ceab5c39ee3b15a5fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Creating volume dd9da3f2-2768-4090-92d2-200d831b84a0 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:03:54 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dd9da3f2-2768-4090-92d2-200d831b84a0 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:54 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dd9da3f2-2768-4090-92d2-200d831b84a0 1073741824 Sep 28 17:03:54 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] Acquiring lock "cinder-quobyte-cff8ce22-b155-44c8-945d-861254799923" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] Lock "cinder-quobyte-cff8ce22-b155-44c8-945d-861254799923" acquired by "delete_volume" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31d4b8c-5833-469d-9e10-151ba7a993dd]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:03:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cff8ce22-b155-44c8-945d-861254799923 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:55 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cff8ce22-b155-44c8-945d-861254799923 Sep 28 17:03:55 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:55 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dd9da3f2-2768-4090-92d2-200d831b84a0 1073741824" returned: 0 in 0.992s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:55 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cff8ce22-b155-44c8-945d-861254799923" returned: 0 in 0.843s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cff8ce22-b155-44c8-945d-861254799923 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dd9da3f2-2768-4090-92d2-200d831b84a0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:55 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cff8ce22-b155-44c8-945d-861254799923 Sep 28 17:03:55 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:55 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dd9da3f2-2768-4090-92d2-200d831b84a0 Sep 28 17:03:55 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:56 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cff8ce22-b155-44c8-945d-861254799923" returned: 0 in 0.620s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] Lock "cinder-quobyte-cff8ce22-b155-44c8-945d-861254799923" released by "delete_volume" :: held 1.572s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:03:56 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dd9da3f2-2768-4090-92d2-200d831b84a0" returned: 0 in 0.688s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-628fa165-5192-4dd6-8941-353189832e0f req-b429adf6-d65c-4da3-a530-be57aaca8600 tempest-ServerActionsTestOtherA-871510388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-628fa165-5192-4dd6-8941-353189832e0f req-b429adf6-d65c-4da3-a530-be57aaca8600 tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-628fa165-5192-4dd6-8941-353189832e0f req-b429adf6-d65c-4da3-a530-be57aaca8600 tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d6018c-fa50-467b-afbe-828325073067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd9da3f2-2768-4090-92d2-200d831b84a0', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1da0c21-cf43-4aa9-8f57-e77e93787b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] Created reservations ['98a45341-23ba-47c0-9942-3b448abfa7b7', '41b07f2a-1a19-4452-a037-c4b83e078ef8', '5d01511c-f585-4f2b-af26-9107bae0998b', 'f8e26718-6168-41a5-b028-069f914fc3dc'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:03:56 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Volume volume-dd9da3f2-2768-4090-92d2-200d831b84a0 (dd9da3f2-2768-4090-92d2-200d831b84a0): created successfully Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1da0c21-cf43-4aa9-8f57-e77e93787b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Flow 'volume_create_manager' (573e46b7-6c7f-4b43-baa8-91b03ac7b424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:03:56 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-6f3a133b-1e96-420b-a4c9-1efbb3dfeb7f tempest-ServerRescueNegativeTestJSON-1517036705 None] Created volume successfully. Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-628fa165-5192-4dd6-8941-353189832e0f req-b429adf6-d65c-4da3-a530-be57aaca8600 tempest-ServerActionsTestOtherA-871510388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5dce889-e04c-4c56-b3f1-e2bd88242264', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:56 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-628fa165-5192-4dd6-8941-353189832e0f req-b429adf6-d65c-4da3-a530-be57aaca8600 tempest-ServerActionsTestOtherA-871510388 None] attachment_update completed successfully. Sep 28 17:03:56 devstack sudo[91509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:03:56 devstack sudo[91509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:57 devstack sudo[91509]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.837s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:57 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:03:57 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] Deleted volume successfully. Sep 28 17:03:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-35597a69-5553-45fb-beb0-00545d078255 tempest-AttachVolumeShelveTestJSON-612947882 None] Lock "cinder-cff8ce22-b155-44c8-945d-861254799923-delete_volume" released by "delete_volume" :: held 3.517s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:04:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:01 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:04:01 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:01 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.550s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:04:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:04:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:04:12 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=25,cinder:INSERT=10,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:04:12 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=22,cinder:UPDATE=18,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:04:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] Acquiring lock "cinder-dd9da3f2-2768-4090-92d2-200d831b84a0-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] Lock "cinder-dd9da3f2-2768-4090-92d2-200d831b84a0-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] Acquiring lock "cinder-quobyte-dd9da3f2-2768-4090-92d2-200d831b84a0" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] Lock "cinder-quobyte-dd9da3f2-2768-4090-92d2-200d831b84a0" acquired by "delete_volume" :: waited 0.050s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:22 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1ef81d-4c81-49fe-82c8-00174968e34f]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:04:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dd9da3f2-2768-4090-92d2-200d831b84a0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:23 devstack sudo[92282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dd9da3f2-2768-4090-92d2-200d831b84a0 Sep 28 17:04:23 devstack sudo[92282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:24 devstack sudo[92282]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dd9da3f2-2768-4090-92d2-200d831b84a0" returned: 0 in 1.290s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dd9da3f2-2768-4090-92d2-200d831b84a0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:24 devstack sudo[92289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dd9da3f2-2768-4090-92d2-200d831b84a0 Sep 28 17:04:24 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:25 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dd9da3f2-2768-4090-92d2-200d831b84a0" returned: 0 in 1.003s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:25 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] Lock "cinder-quobyte-dd9da3f2-2768-4090-92d2-200d831b84a0" released by "delete_volume" :: held 2.457s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:25 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] Created reservations ['c37585bf-a820-4b48-aa27-96916fef2b7b', '6b5f5a20-8f4d-4f82-ad59-59ef2a75391c', 'bc8425b3-da3c-463d-8afc-87608df06a30', 'a59300e1-eccc-487b-82b2-00d25189982b'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:04:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:25 devstack sudo[92318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:04:25 devstack sudo[92318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:26 devstack sudo[92318]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.712s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:26 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:26 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] Deleted volume successfully. Sep 28 17:04:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3230325c-4c44-4881-a7ce-a0373c23c30d tempest-ServerRescueNegativeTestJSON-1517036705 None] Lock "cinder-dd9da3f2-2768-4090-92d2-200d831b84a0-delete_volume" released by "delete_volume" :: held 4.048s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:33 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-e471a992-d47b-49a0-8d76-2e15be9b121c tempest-GroupSnapshotsTest-974775426 None] Group tempest-GroupSnapshotsTest-Group-455620: creating Sep 28 17:04:34 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-e471a992-d47b-49a0-8d76-2e15be9b121c tempest-GroupSnapshotsTest-974775426 None] Group tempest-GroupSnapshotsTest-Group-455620: created successfully Sep 28 17:04:34 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-e471a992-d47b-49a0-8d76-2e15be9b121c tempest-GroupSnapshotsTest-974775426 None] Create group completed successfully. Sep 28 17:04:36 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Flow 'volume_create_manager' (3ce4bc18-280c-4db4-bec8-6d2de4386055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0685935e-a356-4415-84ff-81a6cd702ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0685935e-a356-4415-84ff-81a6cd702ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1529592602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c7e0c40-ba35-4a44-b7a6-ec96ea919528,host='devstack@QuobyteHD#QuobyteHD',id=77d0519b-1ab5-4fa8-a95e-6355400098f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b311f7206829413a876c9ce2382fa30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:37Z,use_quota=True,user_id='0bae745f522b45d1b95291b8c28866a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c986c683-3063-4ffe-8275-7730f2d7ac2a),volume_type_id=c986c683-3063-4ffe-8275-7730f2d7ac2a)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ce1ab6-4fdd-4233-a263-6d19394c9dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ce1ab6-4fdd-4233-a263-6d19394c9dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751ffd67-6109-4088-9c64-a0c2bbbbb159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751ffd67-6109-4088-9c64-a0c2bbbbb159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77d0519b-1ab5-4fa8-a95e-6355400098f0', 'volume_name': 'volume-77d0519b-1ab5-4fa8-a95e-6355400098f0', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a273f7-5888-43e6-b2a6-151b7f7a083a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a273f7-5888-43e6-b2a6-151b7f7a083a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83680b4c-d3f0-41dd-8551-5ceb463460f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:37 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Volume 77d0519b-1ab5-4fa8-a95e-6355400098f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77d0519b-1ab5-4fa8-a95e-6355400098f0', 'volume_size': 1} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6c7e0c40-ba35-4a44-b7a6-ec96ea919528,created_at=2026-09-28T15:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1529592602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c7e0c40-ba35-4a44-b7a6-ec96ea919528,host='devstack@QuobyteHD#QuobyteHD',id=77d0519b-1ab5-4fa8-a95e-6355400098f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b311f7206829413a876c9ce2382fa30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:37Z,use_quota=True,user_id='0bae745f522b45d1b95291b8c28866a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c986c683-3063-4ffe-8275-7730f2d7ac2a),volume_type_id=c986c683-3063-4ffe-8275-7730f2d7ac2a)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Creating volume 77d0519b-1ab5-4fa8-a95e-6355400098f0 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:04:37 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:37 devstack sudo[92440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 1073741824 Sep 28 17:04:37 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:37 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-f8678633-32b0-4f2a-81b1-f476d857e6b8 req-9650f5c3-9572-4756-93cc-8d79e78722c0 tempest-ServerActionsTestOtherA-871510388 None] Terminate volume connection completed successfully. Sep 28 17:04:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-f8678633-32b0-4f2a-81b1-f476d857e6b8 req-9650f5c3-9572-4756-93cc-8d79e78722c0 tempest-ServerActionsTestOtherA-871510388 None] Deleting attachment c5dce889-e04c-4c56-b3f1-e2bd88242264. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:04:38 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 1073741824" returned: 0 in 1.356s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:38 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 Sep 28 17:04:38 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:39 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0" returned: 0 in 0.701s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:04:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83680b4c-d3f0-41dd-8551-5ceb463460f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77d0519b-1ab5-4fa8-a95e-6355400098f0', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207d032f-1be0-4907-82f9-8e882299ee25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:39 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Volume volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 (77d0519b-1ab5-4fa8-a95e-6355400098f0): created successfully Sep 28 17:04:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207d032f-1be0-4907-82f9-8e882299ee25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Flow 'volume_create_manager' (3ce4bc18-280c-4db4-bec8-6d2de4386055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:39 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-23227f83-2eb0-421a-9f91-16f1e485dc2b tempest-GroupSnapshotsTest-974775426 None] Created volume successfully. Sep 28 17:04:41 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] GroupSnapshot 3b7013a9-25ef-41d5-bbaf-c9f13544eef3: creating. Sep 28 17:04:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] Group snapshot 3b7013a9-25ef-41d5-bbaf-c9f13544eef3: creating. {{(pid=86970) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:04:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] Creating offline snapshot a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f of volume 77d0519b-1ab5-4fa8-a95e-6355400098f0 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:04:41 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bc48d8-de2c-4097-beda-121f674f2d10]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:04:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:41 devstack sudo[92524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 Sep 28 17:04:41 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-f8678633-32b0-4f2a-81b1-f476d857e6b8 req-6d8453a6-05af-4942-9504-c37e1a751b68 tempest-ServerActionsTestOtherA-871510388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:42 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0" returned: 0 in 0.683s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:42 devstack sudo[92540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f 1G Sep 28 17:04:42 devstack sudo[92540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:42 devstack sudo[92540]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f 1G" returned: 0 in 0.604s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:42 devstack sudo[92546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f Sep 28 17:04:42 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:43 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f" returned: 0 in 0.564s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:43 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:04:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:43 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f Sep 28 17:04:43 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:43 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f" returned: 0 in 0.389s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:43 devstack sudo[92556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.info Sep 28 17:04:43 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:44 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.info" returned: 0 in 0.383s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:44 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:04:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:44 devstack sudo[92576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.info Sep 28 17:04:44 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:44 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.info" returned: 0 in 0.320s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.062s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-f8678633-32b0-4f2a-81b1-f476d857e6b8 req-6d8453a6-05af-4942-9504-c37e1a751b68 tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.406s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-f8678633-32b0-4f2a-81b1-f476d857e6b8 req-6d8453a6-05af-4942-9504-c37e1a751b68 tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.069s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-f8678633-32b0-4f2a-81b1-f476d857e6b8 req-6d8453a6-05af-4942-9504-c37e1a751b68 tempest-ServerActionsTestOtherA-871510388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a56248a-9738-4783-bf79-c441cee82b53', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:04:44 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-91b446b0-a590-4e8d-8daa-cba6252c1e97 tempest-GroupSnapshotsTest-974775426 None] group_snapshot 3b7013a9-25ef-41d5-bbaf-c9f13544eef3: created successfully Sep 28 17:04:44 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-f8678633-32b0-4f2a-81b1-f476d857e6b8 req-6d8453a6-05af-4942-9504-c37e1a751b68 tempest-ServerActionsTestOtherA-871510388 None] attachment_update completed successfully. Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "cinder-quobyte-a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15" by "_create_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Creating volume 5e769f52-bc19-4cb7-a32a-ab2b19fb5a15 from snapshot a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f {{(pid=86970) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "cinder-quobyte-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15" by "_copy_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] snapshot: a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f, volume: 5e769f52-bc19-4cb7-a32a-ab2b19fb5a15, {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[e378f564-4014-49e6-8820-2e3ea5ac94a0]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:04:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:47 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f Sep 28 17:04:47 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:47 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f" returned: 0 in 0.785s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:47 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77d0519b-1ab5-4fa8-a95e-6355400098f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:04:47 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cac2f67-981a-4ea9-88e1-44a3b2a3700a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:04:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:47 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 Sep 28 17:04:47 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:48 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0" returned: 0 in 0.726s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:48 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:04:48 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Creating direct copy from snapshot {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:04:48 devstack cinder-volume[86970]: DEBUG cinder.utils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Path /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15 not found in is_blk_device check {{(pid=86970) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:04:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:48 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15 Sep 28 17:04:48 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:52 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:04:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Flow 'volume_create_manager' (5d7e754e-e727-4a04-a71e-45b02d748218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e980556a-e3a5-4acb-9424-6144387413a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e980556a-e3a5-4acb-9424-6144387413a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-35319018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040fbbec-db0f-4d86-a36d-8345c5cc7fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d300ac7bcf2b42f88f86c2c2a6ecd1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:52Z,use_quota=True,user_id='a9b03312f07941b4bfd309ce48235913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08bd30f-fe4e-4045-840d-f2ed11c3a3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08bd30f-fe4e-4045-840d-f2ed11c3a3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e624d21d-431b-4a82-800f-8dff89691175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e624d21d-431b-4a82-800f-8dff89691175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '040fbbec-db0f-4d86-a36d-8345c5cc7fd8', 'volume_name': 'volume-040fbbec-db0f-4d86-a36d-8345c5cc7fd8', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f804cc-9bf6-44b5-b2bc-6ecd72b8d874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f804cc-9bf6-44b5-b2bc-6ecd72b8d874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b477736-2c52-459f-bb99-954b2624e946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:52 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Volume 040fbbec-db0f-4d86-a36d-8345c5cc7fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-040fbbec-db0f-4d86-a36d-8345c5cc7fd8', 'volume_size': 1} Sep 28 17:04:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:00 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15" returned: 0 in 11.951s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:00 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Image conversion details: src /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0, size 1024.00 MB, duration 11.95 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15 {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:05:00 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Converted 1024.00 MB image at 85.66 MB/s Sep 28 17:05:00 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:05:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:00 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15 Sep 28 17:05:00 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:00 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15" returned: 0 in 0.621s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15" released by "_copy_volume_from_snapshot" :: held 14.273s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:01 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:05:01 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15" released by "_create_volume_from_snapshot" :: held 14.452s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.494s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.199s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-35319018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040fbbec-db0f-4d86-a36d-8345c5cc7fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d300ac7bcf2b42f88f86c2c2a6ecd1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:52Z,use_quota=True,user_id='a9b03312f07941b4bfd309ce48235913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Creating volume 040fbbec-db0f-4d86-a36d-8345c5cc7fd8 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:05:01 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-040fbbec-db0f-4d86-a36d-8345c5cc7fd8 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:01 devstack sudo[93157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-040fbbec-db0f-4d86-a36d-8345c5cc7fd8 1073741824 Sep 28 17:05:01 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:01 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-e5815574-eacd-4428-a09b-e37e8b1ba609 tempest-GroupSnapshotsTest-974775426 None] Create group from source-snapshot-3b7013a9-25ef-41d5-bbaf-c9f13544eef3 completed successfully. Sep 28 17:05:01 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.412s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:05:01 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-040fbbec-db0f-4d86-a36d-8345c5cc7fd8 1073741824" returned: 0 in 0.757s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-040fbbec-db0f-4d86-a36d-8345c5cc7fd8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:01 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-040fbbec-db0f-4d86-a36d-8345c5cc7fd8 Sep 28 17:05:02 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:02 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-040fbbec-db0f-4d86-a36d-8345c5cc7fd8" returned: 0 in 0.372s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:05:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b477736-2c52-459f-bb99-954b2624e946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040fbbec-db0f-4d86-a36d-8345c5cc7fd8', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3249dc-4fb3-4741-a281-7225ef2d4a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:02 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Volume volume-040fbbec-db0f-4d86-a36d-8345c5cc7fd8 (040fbbec-db0f-4d86-a36d-8345c5cc7fd8): created successfully Sep 28 17:05:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3249dc-4fb3-4741-a281-7225ef2d4a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Flow 'volume_create_manager' (5d7e754e-e727-4a04-a71e-45b02d748218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:02 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-9462f83a-30fe-4c4f-8382-cda61d56a250 tempest-ServersNegativeTestJSON-1445404772 None] Created volume successfully. Sep 28 17:05:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "cinder-quobyte-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15" acquired by "delete_volume" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:02 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5971383-45db-46c0-8c1e-f88d19cddf86]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:03 devstack sudo[93181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15 Sep 28 17:05:03 devstack sudo[93181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:03 devstack sudo[93181]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15" returned: 0 in 0.536s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:03 devstack sudo[93186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15 Sep 28 17:05:03 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:03 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15" returned: 0 in 0.415s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-5e769f52-bc19-4cb7-a32a-ab2b19fb5a15" released by "delete_volume" :: held 1.018s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:03 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] Created reservations ['fbd37f10-fffb-4a13-b432-7b6e446bd9fe'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:04 devstack cinder-volume[86970]: WARNING cinder.quota [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1774479515 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1774479515, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:05:04 devstack cinder-volume[86970]: WARNING cinder.quota [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1774479515 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1774479515, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:05:04 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] Created reservations ['eef54dc5-1220-4e5a-b956-68696dc3f49b', '59dabf46-c384-4ef6-b57d-dfd48928b774', '18155f04-7a06-4da7-a805-2a6f4230e6d6', '04d59c92-746a-4c80-bbd8-f55e2bf4928a'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:04 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:05:04 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:04 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.518s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:04 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:04 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d6eecac6-bbdc-40d5-9b34-bdb825b771ca tempest-GroupSnapshotsTest-974775426 None] Delete group completed successfully. Sep 28 17:05:05 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] group_snapshot 3b7013a9-25ef-41d5-bbaf-c9f13544eef3: deleting Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] group_snapshot 3b7013a9-25ef-41d5-bbaf-c9f13544eef3: deleting {{(pid=86970) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "cinder-quobyte-77d0519b-1ab5-4fa8-a95e-6355400098f0" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-77d0519b-1ab5-4fa8-a95e-6355400098f0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "cinder-quobyte-a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] Deleting offline snapshot a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f of volume 77d0519b-1ab5-4fa8-a95e-6355400098f0 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] snapshot_file for this snap is: volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5e9304-5793-49be-aff6-48ac6a6ae1fe]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Flow 'volume_create_manager' (394f6121-ad02-4241-99b2-876bf6a1916f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cff91f-2851-4341-af3e-6a15d90b3b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cff91f-2851-4341-af3e-6a15d90b3b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1855822367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f96177-1679-47bb-8151-d3956e438982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d300ac7bcf2b42f88f86c2c2a6ecd1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:06Z,use_quota=True,user_id='a9b03312f07941b4bfd309ce48235913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f490645-1b2b-4bc0-a22c-c4e11820973f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f490645-1b2b-4bc0-a22c-c4e11820973f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ede3d9-67da-4ddd-900f-92ae6780f753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ede3d9-67da-4ddd-900f-92ae6780f753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9f96177-1679-47bb-8151-d3956e438982', 'volume_name': 'volume-e9f96177-1679-47bb-8151-d3956e438982', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c629858-305b-4047-84d3-9f71074da6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c629858-305b-4047-84d3-9f71074da6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aeb2def-c5e2-43a5-8915-a1f543dbbf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:05 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Volume e9f96177-1679-47bb-8151-d3956e438982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9f96177-1679-47bb-8151-d3956e438982', 'volume_size': 1} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1855822367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f96177-1679-47bb-8151-d3956e438982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d300ac7bcf2b42f88f86c2c2a6ecd1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:06Z,use_quota=True,user_id='a9b03312f07941b4bfd309ce48235913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Creating volume e9f96177-1679-47bb-8151-d3956e438982 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:05:05 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:05:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e9f96177-1679-47bb-8151-d3956e438982 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:05 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f Sep 28 17:05:05 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e9f96177-1679-47bb-8151-d3956e438982 1073741824 Sep 28 17:05:05 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:05 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:06 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f" returned: 0 in 0.493s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77d0519b-1ab5-4fa8-a95e-6355400098f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:06 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac8ba77-d2ca-4407-aecb-f573f0c9b869]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:06 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 Sep 28 17:05:06 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:06 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e9f96177-1679-47bb-8151-d3956e438982 1073741824" returned: 0 in 0.738s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e9f96177-1679-47bb-8151-d3956e438982 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:06 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e9f96177-1679-47bb-8151-d3956e438982 Sep 28 17:05:06 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:07 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e9f96177-1679-47bb-8151-d3956e438982" returned: 0 in 0.324s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:05:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aeb2def-c5e2-43a5-8915-a1f543dbbf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9f96177-1679-47bb-8151-d3956e438982', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242bf283-2565-432c-bf57-c1e0f7be83b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:07 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Volume volume-e9f96177-1679-47bb-8151-d3956e438982 (e9f96177-1679-47bb-8151-d3956e438982): created successfully Sep 28 17:05:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242bf283-2565-432c-bf57-c1e0f7be83b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Flow 'volume_create_manager' (394f6121-ad02-4241-99b2-876bf6a1916f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:07 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-217986f9-04eb-40f0-af65-fa6b49a3de51 tempest-ServersNegativeTestJSON-1445404772 None] Created volume successfully. Sep 28 17:05:07 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0" returned: 0 in 0.864s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:07 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f Sep 28 17:05:07 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:07 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f" returned: 0 in 0.363s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:07 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f Sep 28 17:05:07 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:08 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0.a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f" returned: 0 in 0.562s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-a2b3c457-70bb-4fd3-af7e-1b5267ba4e4f" released by "_delete_snapshot" :: held 2.520s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-77d0519b-1ab5-4fa8-a95e-6355400098f0" released by "delete_snapshot" :: held 2.574s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:08 devstack cinder-volume[86970]: WARNING cinder.quota [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1774479515 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1774479515, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:05:08 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] Created reservations ['d0ae25fe-3a03-4d37-9409-68cf37a0e680', 'c5e02ccf-3bd8-4dc3-92ac-c3649525a1ce', '0f53e84b-7fa4-49eb-b99e-b335d729290d', 'f063f04a-d747-4d61-a556-314fbc3d348c'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:08 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-74ab2937-3dbb-4974-93ca-c5bcc248c883 tempest-GroupSnapshotsTest-974775426 None] group_snapshot 3b7013a9-25ef-41d5-bbaf-c9f13544eef3: deleted successfully Sep 28 17:05:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] Acquiring lock "cinder-e9f96177-1679-47bb-8151-d3956e438982-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] Lock "cinder-e9f96177-1679-47bb-8151-d3956e438982-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] Acquiring lock "cinder-quobyte-e9f96177-1679-47bb-8151-d3956e438982" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] Lock "cinder-quobyte-e9f96177-1679-47bb-8151-d3956e438982" acquired by "delete_volume" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:08 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3569e86-534c-4578-beb9-3592c5a133ce]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e9f96177-1679-47bb-8151-d3956e438982 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:08 devstack sudo[93244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e9f96177-1679-47bb-8151-d3956e438982 Sep 28 17:05:08 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:09 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e9f96177-1679-47bb-8151-d3956e438982" returned: 0 in 0.524s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e9f96177-1679-47bb-8151-d3956e438982 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:09 devstack sudo[93250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e9f96177-1679-47bb-8151-d3956e438982 Sep 28 17:05:09 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "cinder-quobyte-77d0519b-1ab5-4fa8-a95e-6355400098f0" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-77d0519b-1ab5-4fa8-a95e-6355400098f0" acquired by "delete_volume" :: waited 0.042s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:09 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc7b532-7603-4bf6-9165-b1d3550f7a9c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:09 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e9f96177-1679-47bb-8151-d3956e438982" returned: 0 in 0.625s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] Lock "cinder-quobyte-e9f96177-1679-47bb-8151-d3956e438982" released by "delete_volume" :: held 1.239s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:09 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] Created reservations ['eaa7a237-3e9c-4ccf-b151-ea9ae9dab94e', '7b585f67-ca0b-49f9-bc39-38d401f96789', 'e65a1f4a-600b-4451-a0d6-6abbf801e412', 'cb34064f-e2b3-4454-af38-c87156900cc2'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:09 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 Sep 28 17:05:09 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:10 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:05:10 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:10 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0" returned: 0 in 0.640s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:10 devstack sudo[93264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0 Sep 28 17:05:10 devstack sudo[93264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:10 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.434s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:10 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:10 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] Deleted volume successfully. Sep 28 17:05:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-59cc49e0-5572-4cb4-8fdd-1198e767cece tempest-ServersNegativeTestJSON-1445404772 None] Lock "cinder-e9f96177-1679-47bb-8151-d3956e438982-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:11 devstack sudo[93264]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] Acquiring lock "cinder-040fbbec-db0f-4d86-a36d-8345c5cc7fd8-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-77d0519b-1ab5-4fa8-a95e-6355400098f0" returned: 0 in 0.620s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-77d0519b-1ab5-4fa8-a95e-6355400098f0" released by "delete_volume" :: held 1.409s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] Lock "cinder-040fbbec-db0f-4d86-a36d-8345c5cc7fd8-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] Acquiring lock "cinder-quobyte-040fbbec-db0f-4d86-a36d-8345c5cc7fd8" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] Lock "cinder-quobyte-040fbbec-db0f-4d86-a36d-8345c5cc7fd8" acquired by "delete_volume" :: waited 0.056s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[63031497-5e34-4078-90e5-4a5fad1ca5cf]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-040fbbec-db0f-4d86-a36d-8345c5cc7fd8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] Created reservations ['e4accf2c-75a5-4587-b30e-0e8ce8a190b0'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:11 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-040fbbec-db0f-4d86-a36d-8345c5cc7fd8 Sep 28 17:05:11 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:11 devstack cinder-volume[86970]: WARNING cinder.db.api [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1774479515'] Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] Created reservations ['ebd33875-bff5-48f2-8e5c-bcb4be3ad4f6', '863f8d79-57b2-4671-b3d1-26d97af9f837', 'dde3ffa4-afb6-435f-95ac-e22406958f57', 'a9a2ef27-bcea-46a4-8c91-d5067bc0b59a'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:11 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:05:11 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:11 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-040fbbec-db0f-4d86-a36d-8345c5cc7fd8" returned: 0 in 0.582s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-040fbbec-db0f-4d86-a36d-8345c5cc7fd8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:11 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-040fbbec-db0f-4d86-a36d-8345c5cc7fd8 Sep 28 17:05:11 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:12 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.497s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:12 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:12 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-b6202396-24a8-439b-bb60-5b35cbc442b2 tempest-GroupSnapshotsTest-974775426 None] Delete group completed successfully. Sep 28 17:05:12 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-040fbbec-db0f-4d86-a36d-8345c5cc7fd8" returned: 0 in 0.522s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:12 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] Lock "cinder-quobyte-040fbbec-db0f-4d86-a36d-8345c5cc7fd8" released by "delete_volume" :: held 1.195s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:12 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] Created reservations ['0f52ef65-e520-43dc-9a0b-377b64e4660d', 'ec215365-d5a9-4fd2-a19d-75ef49c8dda5', 'a34a51cc-702e-4bad-96dd-cc0a998d9c10', '8c07d2dd-c607-472a-bdfb-710825250eae'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:12 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:05:12 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:12 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.379s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:12 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:12 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] Deleted volume successfully. Sep 28 17:05:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-aedf3e94-7193-4a16-9aeb-9397fabf7cf1 tempest-ServersNegativeTestJSON-1445404772 None] Lock "cinder-040fbbec-db0f-4d86-a36d-8345c5cc7fd8-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:13 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d6a24b8e-cfd1-4b37-92be-a618b0fe1866 tempest-GroupSnapshotsTest-974775426 None] Group tempest-GroupSnapshotsTest-Group-1678943386: creating Sep 28 17:05:13 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d6a24b8e-cfd1-4b37-92be-a618b0fe1866 tempest-GroupSnapshotsTest-974775426 None] Group tempest-GroupSnapshotsTest-Group-1678943386: created successfully Sep 28 17:05:13 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d6a24b8e-cfd1-4b37-92be-a618b0fe1866 tempest-GroupSnapshotsTest-974775426 None] Create group completed successfully. Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Flow 'volume_create_manager' (1c3bfbda-a42a-45b8-a5cb-9843c9fe0757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de64e86-00e6-475f-9308-c424bdf435d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de64e86-00e6-475f-9308-c424bdf435d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-342041223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52e6635c-ea61-4fb4-a4b2-f3cc486ac480,host='devstack@QuobyteHD#QuobyteHD',id=e46fd4e2-98ee-4737-89fb-f6fb1c7746a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b311f7206829413a876c9ce2382fa30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:15Z,use_quota=True,user_id='0bae745f522b45d1b95291b8c28866a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00b9b68e-cabc-437f-9c50-9a6cca820053),volume_type_id=00b9b68e-cabc-437f-9c50-9a6cca820053)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75134b93-6042-4250-ad5c-55c8371fd107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75134b93-6042-4250-ad5c-55c8371fd107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81fc73e-c32a-42f7-9df6-9e37f55700f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81fc73e-c32a-42f7-9df6-9e37f55700f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e46fd4e2-98ee-4737-89fb-f6fb1c7746a9', 'volume_name': 'volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6778dd2c-adec-495e-9597-7853074d6a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6778dd2c-adec-495e-9597-7853074d6a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9396cba4-88e5-4776-a9fb-ec99283cf998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:15 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Volume e46fd4e2-98ee-4737-89fb-f6fb1c7746a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9', 'volume_size': 1} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=52e6635c-ea61-4fb4-a4b2-f3cc486ac480,created_at=2026-09-28T15:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-342041223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52e6635c-ea61-4fb4-a4b2-f3cc486ac480,host='devstack@QuobyteHD#QuobyteHD',id=e46fd4e2-98ee-4737-89fb-f6fb1c7746a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b311f7206829413a876c9ce2382fa30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:15Z,use_quota=True,user_id='0bae745f522b45d1b95291b8c28866a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00b9b68e-cabc-437f-9c50-9a6cca820053),volume_type_id=00b9b68e-cabc-437f-9c50-9a6cca820053)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Creating volume e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:05:15 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:05:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:15 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 1073741824 Sep 28 17:05:15 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:16 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 1073741824" returned: 0 in 0.760s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:16 devstack sudo[93329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 Sep 28 17:05:16 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:16 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9" returned: 0 in 0.311s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:05:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9396cba4-88e5-4776-a9fb-ec99283cf998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf7cdba-9d1c-441c-85fa-90586c92251a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:16 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Volume volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 (e46fd4e2-98ee-4737-89fb-f6fb1c7746a9): created successfully Sep 28 17:05:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf7cdba-9d1c-441c-85fa-90586c92251a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Flow 'volume_create_manager' (1c3bfbda-a42a-45b8-a5cb-9843c9fe0757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:16 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-f5d0a3f7-ff7d-4fb8-a56d-7b969b6389be tempest-GroupSnapshotsTest-974775426 None] Created volume successfully. Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Flow 'volume_create_manager' (597d3eeb-797e-4b24-a65f-511b043245bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fd2988-dfb2-46cb-b4fe-8470033688e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fd2988-dfb2-46cb-b4fe-8470033688e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-139109389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52e6635c-ea61-4fb4-a4b2-f3cc486ac480,host='devstack@QuobyteHD#QuobyteHD',id=b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b311f7206829413a876c9ce2382fa30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:19Z,use_quota=True,user_id='0bae745f522b45d1b95291b8c28866a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00b9b68e-cabc-437f-9c50-9a6cca820053),volume_type_id=00b9b68e-cabc-437f-9c50-9a6cca820053)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01d7526-d31a-44d6-b2f8-cb09a2fe57d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01d7526-d31a-44d6-b2f8-cb09a2fe57d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd14444-cae4-496e-a5d6-9067ebd1def5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd14444-cae4-496e-a5d6-9067ebd1def5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f', 'volume_name': 'volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9b36a1-9c05-4869-bcc1-41a494a8a70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9b36a1-9c05-4869-bcc1-41a494a8a70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8910773e-0791-4ab5-a75b-abfbfb4edf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:18 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Volume b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f', 'volume_size': 1} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=52e6635c-ea61-4fb4-a4b2-f3cc486ac480,created_at=2026-09-28T15:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-139109389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52e6635c-ea61-4fb4-a4b2-f3cc486ac480,host='devstack@QuobyteHD#QuobyteHD',id=b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b311f7206829413a876c9ce2382fa30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:19Z,use_quota=True,user_id='0bae745f522b45d1b95291b8c28866a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00b9b68e-cabc-437f-9c50-9a6cca820053),volume_type_id=00b9b68e-cabc-437f-9c50-9a6cca820053)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Creating volume b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:05:18 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:05:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:19 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f 1073741824 Sep 28 17:05:19 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:19 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f 1073741824" returned: 0 in 0.733s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:19 devstack sudo[93342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f Sep 28 17:05:19 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:20 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f" returned: 0 in 0.413s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:05:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8910773e-0791-4ab5-a75b-abfbfb4edf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab03342e-64bd-4201-a555-0ba896869b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:20 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Volume volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f (b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f): created successfully Sep 28 17:05:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab03342e-64bd-4201-a555-0ba896869b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Flow 'volume_create_manager' (597d3eeb-797e-4b24-a65f-511b043245bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:20 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-7af8f74b-641c-4955-af0a-4ee37cf3e7a7 tempest-GroupSnapshotsTest-974775426 None] Created volume successfully. Sep 28 17:05:21 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-607eab46-45b4-4268-b5e5-38a05da199c7 tempest-GroupSnapshotsTest-974775426 None] Update group completed successfully. Sep 28 17:05:22 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:UPDATE=83,cinder:SELECT=75,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:05:22 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=72,cinder:INSERT=16,cinder:UPDATE=67,cinder:DELETE=2 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:05:22 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-b4bcafe1-da1c-4e21-9729-ba8e2142ffe0 tempest-GroupSnapshotsTest-974775426 None] Update group completed successfully. Sep 28 17:05:24 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-9f7c24aa-017c-45b3-a420-473ff0319c7c tempest-GroupSnapshotsTest-974775426 None] Update group completed successfully. Sep 28 17:05:25 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-790627c6-09bb-4a13-907f-55f247298458 tempest-GroupSnapshotsTest-974775426 None] Update group completed successfully. Sep 28 17:05:27 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-07132723-2649-4247-a7eb-ace0127e6b5d tempest-ServerActionsTestOtherA-871510388 None] Terminate volume connection completed successfully. Sep 28 17:05:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-07132723-2649-4247-a7eb-ace0127e6b5d tempest-ServerActionsTestOtherA-871510388 None] Deleting attachment 2a56248a-9738-4783-bf79-c441cee82b53. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:05:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] Acquiring lock "cinder-f71802f1-6d7e-4a08-be3b-631e9c5ccda2-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] Lock "cinder-f71802f1-6d7e-4a08-be3b-631e9c5ccda2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] Acquiring lock "cinder-quobyte-f71802f1-6d7e-4a08-be3b-631e9c5ccda2" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] Lock "cinder-quobyte-f71802f1-6d7e-4a08-be3b-631e9c5ccda2" acquired by "delete_volume" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:27 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] GroupSnapshot dccfa420-c896-432d-904d-cd706cb47938: creating. Sep 28 17:05:27 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ce9980-3b76-4f1d-b60e-f94a15337bbf]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Group snapshot dccfa420-c896-432d-904d-cd706cb47938: creating. {{(pid=86970) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:05:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Creating offline snapshot 4b254d13-9b05-4921-bc80-912c3065d6c3 of volume b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:05:28 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17c955e-fd34-414b-8332-dc3c8b0a6ccc]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:28 devstack sudo[93486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2 Sep 28 17:05:28 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:28 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f Sep 28 17:05:28 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:28 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:28 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2" returned: 0 in 0.956s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f" returned: 0 in 0.786s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:28 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2 Sep 28 17:05:28 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:28 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3 1G Sep 28 17:05:28 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:29 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f71802f1-6d7e-4a08-be3b-631e9c5ccda2" returned: 0 in 0.593s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] Lock "cinder-quobyte-f71802f1-6d7e-4a08-be3b-631e9c5ccda2" released by "delete_volume" :: held 1.655s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:29 devstack cinder-volume[86970]: DEBUG cinder.quota [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] Created reservations ['fda5b6bf-50a0-4c33-a655-d297b8c7c3dc', '32bb5bd8-7618-4ba9-84bf-29867816f0a0', '36314a87-939e-463c-b728-79be551d8555', '00af59ca-a6b5-49b9-85e7-1a34a20fc4d3'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:29 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3 1G" returned: 0 in 0.792s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] Acquiring lock "cinder-6d078197-f41d-4555-9167-c947af8549a0-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:29 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3 Sep 28 17:05:29 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] Lock "cinder-6d078197-f41d-4555-9167-c947af8549a0-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:29 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:05:29 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] Acquiring lock "cinder-quobyte-6d078197-f41d-4555-9167-c947af8549a0" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] Lock "cinder-quobyte-6d078197-f41d-4555-9167-c947af8549a0" acquired by "delete_volume" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:30 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bbbb1c-0af5-4d19-8abc-08d990621655]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6d078197-f41d-4555-9167-c947af8549a0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:30 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.604s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:30 devstack cinder-volume[86970]: DEBUG cinder.manager [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:30 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3" returned: 0 in 0.717s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:30 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:05:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:30 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] Deleted volume successfully. Sep 28 17:05:30 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3 Sep 28 17:05:30 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-16abbc8d-8f4b-40ed-833d-bda9261a5b92 req-91c6a8c0-57bd-47e8-bcaf-186495ff8f0d tempest-ServerActionsTestOtherA-871510388 None] Lock "cinder-f71802f1-6d7e-4a08-be3b-631e9c5ccda2-delete_volume" released by "delete_volume" :: held 2.806s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:30 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6d078197-f41d-4555-9167-c947af8549a0 Sep 28 17:05:30 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:30 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3" returned: 0 in 0.411s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:30 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.info Sep 28 17:05:30 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:31 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6d078197-f41d-4555-9167-c947af8549a0" returned: 0 in 0.965s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6d078197-f41d-4555-9167-c947af8549a0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:31 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6d078197-f41d-4555-9167-c947af8549a0 Sep 28 17:05:31 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:31 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.info" returned: 0 in 0.511s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:31 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:05:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:31 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.info Sep 28 17:05:31 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:31 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6d078197-f41d-4555-9167-c947af8549a0" returned: 0 in 0.568s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] Lock "cinder-quobyte-6d078197-f41d-4555-9167-c947af8549a0" released by "delete_volume" :: held 1.671s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:31 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] Created reservations ['23249f59-cae3-4313-8a01-43c9437e3073', '342ef62d-050f-400b-b77c-039aff1ab8e7', '6e863e36-7217-43e3-8e34-68c98d4afaf8', '025e87a3-db4b-42dd-a0a0-163fa8de9256'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:31 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.info" returned: 0 in 0.660s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:32 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:05:32 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.137s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Creating offline snapshot 7baa9607-66b9-445a-b8f5-e13a619b3877 of volume e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:05:32 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1bd34c-903f-40c8-af12-470cefff1b60]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:32 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 Sep 28 17:05:32 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:32 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.550s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:32 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:32 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] Deleted volume successfully. Sep 28 17:05:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3059ffb2-fe9f-431f-8b84-309fd7bc36c7 tempest-ServerActionsTestOtherA-871510388 None] Lock "cinder-6d078197-f41d-4555-9167-c947af8549a0-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:33 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9" returned: 0 in 0.920s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:33 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877 1G Sep 28 17:05:33 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:33 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877 1G" returned: 0 in 0.784s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:33 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877 Sep 28 17:05:33 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:34 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877" returned: 0 in 0.467s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:34 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:05:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:34 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877 Sep 28 17:05:34 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:34 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877" returned: 0 in 0.445s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:34 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.info Sep 28 17:05:34 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:35 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.info" returned: 0 in 0.359s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:35 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:05:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:35 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.info Sep 28 17:05:35 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:35 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.info" returned: 0 in 0.396s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.542s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:35 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-80ea3bc6-b310-49c1-a573-ab1734852679 tempest-GroupSnapshotsTest-974775426 None] group_snapshot dccfa420-c896-432d-904d-cd706cb47938: created successfully Sep 28 17:05:36 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] group_snapshot dccfa420-c896-432d-904d-cd706cb47938: deleting Sep 28 17:05:36 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] group_snapshot dccfa420-c896-432d-904d-cd706cb47938: deleting {{(pid=86970) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:05:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "cinder-quobyte-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "cinder-quobyte-4b254d13-9b05-4921-bc80-912c3065d6c3" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-4b254d13-9b05-4921-bc80-912c3065d6c3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Deleting offline snapshot 4b254d13-9b05-4921-bc80-912c3065d6c3 of volume b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:05:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] snapshot_file for this snap is: volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:05:37 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[43abc5a1-3a65-4d89-ada6-a7ed5d99a652]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:37 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3 Sep 28 17:05:37 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:37 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3" returned: 0 in 0.500s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:37 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[104690ad-62ce-4bcf-9929-aaa82b0aecfa]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:37 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f Sep 28 17:05:37 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:38 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f" returned: 0 in 0.705s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:38 devstack sudo[93606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3 Sep 28 17:05:38 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:38 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3" returned: 0 in 0.629s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:39 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3 Sep 28 17:05:39 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:39 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f.4b254d13-9b05-4921-bc80-912c3065d6c3" returned: 0 in 0.461s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-4b254d13-9b05-4921-bc80-912c3065d6c3" released by "_delete_snapshot" :: held 2.460s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f" released by "delete_snapshot" :: held 2.501s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "cinder-quobyte-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "cinder-quobyte-7baa9607-66b9-445a-b8f5-e13a619b3877" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-7baa9607-66b9-445a-b8f5-e13a619b3877" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Deleting offline snapshot 7baa9607-66b9-445a-b8f5-e13a619b3877 of volume e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:05:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] snapshot_file for this snap is: volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:05:39 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b30b2cc-6acb-4c2d-ab69-b21f63c77ce0]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:39 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877 Sep 28 17:05:39 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:40 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877" returned: 0 in 0.594s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:40 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b5cf45-022c-48aa-ac15-7afc884c6a1c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:40 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 Sep 28 17:05:40 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:40 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9" returned: 0 in 0.676s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:41 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877 Sep 28 17:05:41 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:41 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877" returned: 0 in 0.669s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:41 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877 Sep 28 17:05:41 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:42 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9.7baa9607-66b9-445a-b8f5-e13a619b3877" returned: 0 in 0.557s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-7baa9607-66b9-445a-b8f5-e13a619b3877" released by "_delete_snapshot" :: held 2.709s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9" released by "delete_snapshot" :: held 2.761s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:42 devstack cinder-volume[86970]: WARNING cinder.quota [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-88882519 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-88882519, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:05:42 devstack cinder-volume[86970]: WARNING cinder.quota [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-88882519 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-88882519, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:05:42 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Created reservations ['a7b9068a-e5c5-4ac9-9834-9a0a7834a903', 'cfa40d8e-14d9-40ae-a5d7-008e9f06aa9f', '3a51797b-ce97-4d7d-8e80-9746bf95a468', '2e23a721-9aa9-4e3f-afa2-97c63a64fc08'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:42 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] Created reservations ['ad84f579-4cde-409a-afcc-349ab4f8f6f4', 'd00467cf-28be-4caa-a2c6-e2ee1ed4703d', '9985a51a-b56b-4ebe-9ed4-86e4865cbcec', '9ec71deb-8a59-4c7d-9dfe-396ace2fce97'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:42 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-c135143b-899a-4345-b60d-927d872f03de tempest-GroupSnapshotsTest-974775426 None] group_snapshot dccfa420-c896-432d-904d-cd706cb47938: deleted successfully Sep 28 17:05:44 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "cinder-quobyte-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:44 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f" acquired by "delete_volume" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:44 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfc4e7c-5c44-440e-9af7-cfe9bac13d3d]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:44 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f Sep 28 17:05:44 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:44 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f" returned: 0 in 0.610s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:45 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f Sep 28 17:05:45 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:45 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f" returned: 0 in 0.339s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-b6e2d9cc-d6d2-4f7e-a33b-feaa8a5d197f" released by "delete_volume" :: held 1.048s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "cinder-quobyte-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9" acquired by "delete_volume" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:45 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b7626f-dfa2-4129-998f-6ef88d28ace3]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:45 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 Sep 28 17:05:45 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:46 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9" returned: 0 in 0.583s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:46 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9 Sep 28 17:05:46 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:46 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9" returned: 0 in 0.455s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-e46fd4e2-98ee-4737-89fb-f6fb1c7746a9" released by "delete_volume" :: held 1.180s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:46 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Created reservations ['a9d06ea6-a933-4976-a1e5-fe56880bffa0'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:46 devstack cinder-volume[86970]: WARNING cinder.quota [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-88882519 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-88882519, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:05:46 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Created reservations ['aa5b7d6e-344c-4436-9764-fc314b5ea1f8', 'd603fdcd-c5b1-4f6c-b516-ad92412afff8', 'c637d0d0-29cd-46a4-899d-28e6cde913ec', '4afcc0c8-1f11-48e3-b0f4-314626bdf257'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:47 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Created reservations ['54989787-3e02-4715-a819-bc445c028ab0', '3548fc32-87b4-45b8-bc8c-466f56a4a354', 'ba9ac8db-621c-4030-921e-e73185de160d', 'e324ea67-f216-4d4a-ada7-25383ded06c4'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:47 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:47 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:47 devstack sudo[93726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:05:47 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:47 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.535s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:47 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:47 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a7e039e4-b240-43fe-afc9-6dcf428ea7b3 tempest-GroupSnapshotsTest-974775426 None] Delete group completed successfully. Sep 28 17:05:49 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-725b4e3b-9b05-4be2-aecd-d3be0bc2cefc tempest-GroupSnapshotsTest-974775426 None] Group tempest-GroupSnapshotsTest-Group-1681113940: creating Sep 28 17:05:49 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-725b4e3b-9b05-4be2-aecd-d3be0bc2cefc tempest-GroupSnapshotsTest-974775426 None] Group tempest-GroupSnapshotsTest-Group-1681113940: created successfully Sep 28 17:05:49 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-725b4e3b-9b05-4be2-aecd-d3be0bc2cefc tempest-GroupSnapshotsTest-974775426 None] Create group completed successfully. Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Flow 'volume_create_manager' (83588ffc-4a1b-481d-8049-45c91f46f976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bde2839-6302-407b-9395-40d00b92cd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bde2839-6302-407b-9395-40d00b92cd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1163875743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23d7a133-138a-47e7-b838-4d3e19e30174,host='devstack@QuobyteHD#QuobyteHD',id=9001794a-783c-4774-bd77-7157d1fac366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b311f7206829413a876c9ce2382fa30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:51Z,use_quota=True,user_id='0bae745f522b45d1b95291b8c28866a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(612467bf-1a13-4dc7-af2b-1c4ca72db1c5),volume_type_id=612467bf-1a13-4dc7-af2b-1c4ca72db1c5)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fc3f2d-ff2a-4c76-bd09-e34a4500a1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fc3f2d-ff2a-4c76-bd09-e34a4500a1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf07c03e-d7c9-410a-b707-c5c82250d84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf07c03e-d7c9-410a-b707-c5c82250d84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9001794a-783c-4774-bd77-7157d1fac366', 'volume_name': 'volume-9001794a-783c-4774-bd77-7157d1fac366', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182a4278-81f7-4770-9ffb-206e4d7463df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182a4278-81f7-4770-9ffb-206e4d7463df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e74298e-8ec8-48a4-8e05-8b6d4326da00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:51 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Volume 9001794a-783c-4774-bd77-7157d1fac366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9001794a-783c-4774-bd77-7157d1fac366', 'volume_size': 1} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=23d7a133-138a-47e7-b838-4d3e19e30174,created_at=2026-09-28T15:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1163875743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23d7a133-138a-47e7-b838-4d3e19e30174,host='devstack@QuobyteHD#QuobyteHD',id=9001794a-783c-4774-bd77-7157d1fac366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b311f7206829413a876c9ce2382fa30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:51Z,use_quota=True,user_id='0bae745f522b45d1b95291b8c28866a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(612467bf-1a13-4dc7-af2b-1c4ca72db1c5),volume_type_id=612467bf-1a13-4dc7-af2b-1c4ca72db1c5)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Creating volume 9001794a-783c-4774-bd77-7157d1fac366 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:05:51 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:51 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366 1073741824 Sep 28 17:05:51 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:51 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366 1073741824" returned: 0 in 0.751s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:52 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366 Sep 28 17:05:52 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:52 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366" returned: 0 in 0.341s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:05:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e74298e-8ec8-48a4-8e05-8b6d4326da00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9001794a-783c-4774-bd77-7157d1fac366', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0db3c4-0265-48b7-95eb-23697a49eec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:52 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Volume volume-9001794a-783c-4774-bd77-7157d1fac366 (9001794a-783c-4774-bd77-7157d1fac366): created successfully Sep 28 17:05:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0db3c4-0265-48b7-95eb-23697a49eec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Flow 'volume_create_manager' (83588ffc-4a1b-481d-8049-45c91f46f976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:52 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-da1bb5c1-7351-479c-8532-10b787992373 tempest-GroupSnapshotsTest-974775426 None] Created volume successfully. Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Flow 'volume_create_manager' (09c2eb67-2cd5-4cec-8bf4-eecb57897951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8421d9-90ec-4204-b740-d199efb2b8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8421d9-90ec-4204-b740-d199efb2b8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1429612735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=befcd1ce-b51f-43ea-9b37-e78530a2969b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ee2d4331c44c6d8785581b78b07d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:53Z,use_quota=True,user_id='51a5898f649048f0a735c5af66a0cc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9dd136-f6ca-4af3-884f-702f9432e38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9dd136-f6ca-4af3-884f-702f9432e38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7883ccda-3c48-45e2-b109-bfdf2a686dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7883ccda-3c48-45e2-b109-bfdf2a686dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'befcd1ce-b51f-43ea-9b37-e78530a2969b', 'volume_name': 'volume-befcd1ce-b51f-43ea-9b37-e78530a2969b', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d045d96f-797a-4f94-9eca-9f0070d92b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d045d96f-797a-4f94-9eca-9f0070d92b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ea7415-7d5f-4a37-8aa2-323a713f057d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:53 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Volume befcd1ce-b51f-43ea-9b37-e78530a2969b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-befcd1ce-b51f-43ea-9b37-e78530a2969b', 'volume_size': 1} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1429612735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=befcd1ce-b51f-43ea-9b37-e78530a2969b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ee2d4331c44c6d8785581b78b07d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:53Z,use_quota=True,user_id='51a5898f649048f0a735c5af66a0cc0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Creating volume befcd1ce-b51f-43ea-9b37-e78530a2969b {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:05:53 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:53 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b 1073741824 Sep 28 17:05:53 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:53 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] GroupSnapshot 964dbf1e-52c6-4d5f-86a3-342d26eae95b: creating. Sep 28 17:05:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] Group snapshot 964dbf1e-52c6-4d5f-86a3-342d26eae95b: creating. {{(pid=86970) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Flow 'volume_create_manager' (ab0a5609-4e91-4a09-843b-fa06a9fc59f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d245e7-3f0a-40ae-9beb-286bdd88f461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d245e7-3f0a-40ae-9beb-286bdd88f461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2059544582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890336ef-5098-4030-98d1-021ede16b73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f12840d9eb4403bb7e3ad2e1ce2a58c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:54Z,use_quota=True,user_id='624180bb6a1b419da8069a89f9380f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea01192-c895-4d96-8e44-fb5989967a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea01192-c895-4d96-8e44-fb5989967a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb310eb-4918-44f6-9d38-0531033f0c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb310eb-4918-44f6-9d38-0531033f0c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '890336ef-5098-4030-98d1-021ede16b73f', 'volume_name': 'volume-890336ef-5098-4030-98d1-021ede16b73f', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:54 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6970fb44-8686-42c4-bdfa-d7b832ced952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6970fb44-8686-42c4-bdfa-d7b832ced952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef67db9-f0e9-490f-8c74-893485e0ba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:54 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Volume 890336ef-5098-4030-98d1-021ede16b73f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-890336ef-5098-4030-98d1-021ede16b73f', 'volume_size': 1} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b 1073741824" returned: 0 in 0.734s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:54 devstack sudo[93762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b Sep 28 17:05:54 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:54 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b" returned: 0 in 0.305s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.646s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] Creating offline snapshot 76fe0270-d73e-4c34-9c8d-992f04a8bfa1 of volume 9001794a-783c-4774-bd77-7157d1fac366 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ea7415-7d5f-4a37-8aa2-323a713f057d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-befcd1ce-b51f-43ea-9b37-e78530a2969b', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8fa7dc-5598-46ef-95dc-903a480d69ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd11cf2-f312-45ff-b078-4921a3a29982]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:54 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Volume volume-befcd1ce-b51f-43ea-9b37-e78530a2969b (befcd1ce-b51f-43ea-9b37-e78530a2969b): created successfully Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8fa7dc-5598-46ef-95dc-903a480d69ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Flow 'volume_create_manager' (09c2eb67-2cd5-4cec-8bf4-eecb57897951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:54 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-999b92d0-44f9-4b45-aa96-cf19269d4463 req-d99899f2-bf58-46fb-a59e-12b64df8b73f tempest-VolumesSnapshotsTestJSON-968295704 None] Created volume successfully. Sep 28 17:05:54 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366 Sep 28 17:05:54 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:55 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366" returned: 0 in 0.586s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:55 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1 1G Sep 28 17:05:55 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:55 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1 1G" returned: 0 in 0.650s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9001794a-783c-4774-bd77-7157d1fac366 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:55 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9001794a-783c-4774-bd77-7157d1fac366 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1 Sep 28 17:05:55 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:56 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9001794a-783c-4774-bd77-7157d1fac366 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1" returned: 0 in 0.471s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:56 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:05:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:56 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1 Sep 28 17:05:56 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:56 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1" returned: 0 in 0.356s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:56 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.info Sep 28 17:05:56 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:57 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.info" returned: 0 in 0.311s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:57 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:05:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:57 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.info Sep 28 17:05:57 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:57 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.info" returned: 0 in 0.326s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.839s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.214s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2059544582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890336ef-5098-4030-98d1-021ede16b73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f12840d9eb4403bb7e3ad2e1ce2a58c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:54Z,use_quota=True,user_id='624180bb6a1b419da8069a89f9380f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:05:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Creating volume 890336ef-5098-4030-98d1-021ede16b73f {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:05:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:05:57 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:05:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-890336ef-5098-4030-98d1-021ede16b73f 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:57 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-890336ef-5098-4030-98d1-021ede16b73f 1073741824 Sep 28 17:05:57 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:57 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-5909413f-f360-4b97-8ede-2fb837e7bb03 tempest-GroupSnapshotsTest-974775426 None] group_snapshot 964dbf1e-52c6-4d5f-86a3-342d26eae95b: created successfully Sep 28 17:05:58 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-890336ef-5098-4030-98d1-021ede16b73f 1073741824" returned: 0 in 0.616s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-890336ef-5098-4030-98d1-021ede16b73f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:58 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-890336ef-5098-4030-98d1-021ede16b73f Sep 28 17:05:58 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:58 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-890336ef-5098-4030-98d1-021ede16b73f" returned: 0 in 0.360s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.589s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef67db9-f0e9-490f-8c74-893485e0ba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-890336ef-5098-4030-98d1-021ede16b73f', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2947af0-3c4a-4df5-8d19-1a7fec2ce58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] Creating offline snapshot cc0d582a-0f65-4bac-90d4-cb665a80b3e5 of volume befcd1ce-b51f-43ea-9b37-e78530a2969b {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:05:58 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] group_snapshot 964dbf1e-52c6-4d5f-86a3-342d26eae95b: deleting Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee4df4d-98b0-4829-8999-2f53ea707bcc]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:58 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Volume volume-890336ef-5098-4030-98d1-021ede16b73f (890336ef-5098-4030-98d1-021ede16b73f): created successfully Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2947af0-3c4a-4df5-8d19-1a7fec2ce58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Flow 'volume_create_manager' (ab0a5609-4e91-4a09-843b-fa06a9fc59f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] group_snapshot 964dbf1e-52c6-4d5f-86a3-342d26eae95b: deleting {{(pid=86970) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:05:58 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-fb5c8b07-426a-4132-82e6-b70766560950 tempest-AttachVolumeTestJSON-1953796176 None] Created volume successfully. Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "cinder-quobyte-9001794a-783c-4774-bd77-7157d1fac366" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-9001794a-783c-4774-bd77-7157d1fac366" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "cinder-quobyte-76fe0270-d73e-4c34-9c8d-992f04a8bfa1" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-76fe0270-d73e-4c34-9c8d-992f04a8bfa1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] Deleting offline snapshot 76fe0270-d73e-4c34-9c8d-992f04a8bfa1 of volume 9001794a-783c-4774-bd77-7157d1fac366 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] snapshot_file for this snap is: volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:05:58 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bae5e1-bf15-402d-a290-473aefc38dc3]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:58 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:59 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1 Sep 28 17:05:59 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:59 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b" returned: 0 in 0.771s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:59 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5 1G Sep 28 17:05:59 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:59 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1" returned: 0 in 0.830s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9001794a-783c-4774-bd77-7157d1fac366(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:59 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[0444997e-6b1f-480f-9c06-9ae85b10b449]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:59 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366 Sep 28 17:05:59 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:00 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5 1G" returned: 0 in 0.872s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-befcd1ce-b51f-43ea-9b37-e78530a2969b -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:00 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-befcd1ce-b51f-43ea-9b37-e78530a2969b -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5 Sep 28 17:06:00 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:00 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366" returned: 0 in 0.913s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:00 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1 Sep 28 17:06:00 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:00 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-befcd1ce-b51f-43ea-9b37-e78530a2969b -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5" returned: 0 in 0.720s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:00 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5 is being set with open permissions: ugo+rw Sep 28 17:06:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:01 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5 Sep 28 17:06:01 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:01 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:06:01 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:01 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1" returned: 0 in 0.746s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:01 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-26ab19c0-afdf-4f79-9fd2-ecbe3edede04 req-4f66602e-55f3-4ca6-af4c-afcc4c1d9ec9 tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5" returned: 0 in 0.435s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:01 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1 Sep 28 17:06:01 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:01 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.info Sep 28 17:06:01 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:01 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.536s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:06:01 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366.76fe0270-d73e-4c34-9c8d-992f04a8bfa1" returned: 0 in 0.411s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-76fe0270-d73e-4c34-9c8d-992f04a8bfa1" released by "_delete_snapshot" :: held 3.108s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-9001794a-783c-4774-bd77-7157d1fac366" released by "delete_snapshot" :: held 3.141s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:01 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.info" returned: 0 in 0.476s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:01 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.info is being set with open permissions: ugo+rw Sep 28 17:06:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:01 devstack cinder-volume[86970]: WARNING cinder.quota [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-81152847 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-81152847, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:06:01 devstack cinder-volume[86970]: WARNING cinder.quota [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-81152847 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-81152847, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:06:02 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.info Sep 28 17:06:02 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:02 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] Created reservations ['4632663f-89d8-42df-9f6f-124cc88c6fe7', '82db87c3-1f23-4da0-9a50-8930e32a82e8', 'd045c055-e83d-4607-abce-5c20e87331b7', 'b8ce8183-7672-41f4-9894-d0258fc40c09'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:02 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-02d213f8-a199-495c-be90-c719074a3e2d tempest-GroupSnapshotsTest-974775426 None] group_snapshot 964dbf1e-52c6-4d5f-86a3-342d26eae95b: deleted successfully Sep 28 17:06:02 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.info" returned: 0 in 0.509s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.018s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-26ab19c0-afdf-4f79-9fd2-ecbe3edede04 req-4f66602e-55f3-4ca6-af4c-afcc4c1d9ec9 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.134s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-26ab19c0-afdf-4f79-9fd2-ecbe3edede04 req-4f66602e-55f3-4ca6-af4c-afcc4c1d9ec9 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.088s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:02 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-d82e189d-798a-4008-af3e-901acdf01fa3 req-c8e12f9d-1ff4-43a9-985b-b7be7df5958e tempest-VolumesSnapshotsTestJSON-968295704 None] Create snapshot completed successfully Sep 28 17:06:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-26ab19c0-afdf-4f79-9fd2-ecbe3edede04 req-4f66602e-55f3-4ca6-af4c-afcc4c1d9ec9 tempest-AttachVolumeTestJSON-1953796176 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-890336ef-5098-4030-98d1-021ede16b73f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8ea61af-846c-4dab-829d-8a5db00a33d6', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:06:02 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-26ab19c0-afdf-4f79-9fd2-ecbe3edede04 req-4f66602e-55f3-4ca6-af4c-afcc4c1d9ec9 tempest-AttachVolumeTestJSON-1953796176 None] attachment_update completed successfully. Sep 28 17:06:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Acquiring lock "cinder-cc0d582a-0f65-4bac-90d4-cb665a80b3e5-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "cinder-cc0d582a-0f65-4bac-90d4-cb665a80b3e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Acquiring lock "cinder-quobyte-befcd1ce-b51f-43ea-9b37-e78530a2969b" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "cinder-quobyte-befcd1ce-b51f-43ea-9b37-e78530a2969b" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Acquiring lock "cinder-quobyte-cc0d582a-0f65-4bac-90d4-cb665a80b3e5" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "cinder-quobyte-cc0d582a-0f65-4bac-90d4-cb665a80b3e5" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Deleting offline snapshot cc0d582a-0f65-4bac-90d4-cb665a80b3e5 of volume befcd1ce-b51f-43ea-9b37-e78530a2969b {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:06:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] snapshot_file for this snap is: volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:06:03 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea414b67-88c4-467b-9d3f-62bee6a8e02a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:03 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5 Sep 28 17:06:03 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "cinder-quobyte-9001794a-783c-4774-bd77-7157d1fac366" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-9001794a-783c-4774-bd77-7157d1fac366" acquired by "delete_volume" :: waited 0.048s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:04 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[233ec689-8928-4b41-888b-49b8ad81bdd5]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:04 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5" returned: 0 in 0.819s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-befcd1ce-b51f-43ea-9b37-e78530a2969b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:06:04 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[742a0a1a-94f6-4cb3-a36f-199b1993cd9c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:04 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366 Sep 28 17:06:04 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:04 devstack sudo[94404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b Sep 28 17:06:04 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:04 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366" returned: 0 in 0.784s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:04 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366 Sep 28 17:06:04 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:05 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b" returned: 0 in 0.997s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:05 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5 Sep 28 17:06:05 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:05 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9001794a-783c-4774-bd77-7157d1fac366" returned: 0 in 0.516s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] Lock "cinder-quobyte-9001794a-783c-4774-bd77-7157d1fac366" released by "delete_volume" :: held 1.490s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:05 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] Created reservations ['34841bf5-a359-46c9-952d-e9bf8b323be0'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:05 devstack cinder-volume[86970]: WARNING cinder.quota [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-81152847 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-81152847, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:06:05 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] Created reservations ['f9c143bd-122d-4fd8-9019-39546b5b3725', 'a2a03e15-2519-48ca-824a-376d7020cd07', '9c6a9023-6438-4ea8-98a6-51a37f433c79', '1e311c3f-9170-4b6a-8df5-d82f1564c07f'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:06 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:06:06 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:06 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5" returned: 0 in 0.767s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:06 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5 Sep 28 17:06:06 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:06 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.646s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:06 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:06 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-5c1b4d4f-c9f5-42c5-a6f3-50300d5359b0 tempest-GroupSnapshotsTest-974775426 None] Delete group completed successfully. Sep 28 17:06:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b.cc0d582a-0f65-4bac-90d4-cb665a80b3e5" returned: 0 in 0.716s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:06 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "cinder-quobyte-cc0d582a-0f65-4bac-90d4-cb665a80b3e5" released by "_delete_snapshot" :: held 3.564s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "cinder-quobyte-befcd1ce-b51f-43ea-9b37-e78530a2969b" released by "delete_snapshot" :: held 3.633s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:06 devstack cinder-volume[86970]: WARNING cinder.quota [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:06:06 devstack cinder-volume[86970]: DEBUG cinder.quota [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Created reservations ['9d96f07e-21e7-4828-ada1-b3c4236b8c43', '0b43f52a-bb9d-40fd-a80c-afce67df491d', 'c1537f1e-51cb-447e-bef6-b1309e8e0b7b', '932c0440-b47f-4319-bb02-f3aa96f8e37a'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:07 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Delete snapshot completed successfully. Sep 28 17:06:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-42f45c8d-9a75-4b3f-a09d-d47288d2de24 req-8ae09e66-845b-40df-b5f2-01e630a6c21e tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "cinder-cc0d582a-0f65-4bac-90d4-cb665a80b3e5-delete_snapshot" released by "delete_snapshot" :: held 3.930s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] Acquiring lock "cinder-befcd1ce-b51f-43ea-9b37-e78530a2969b-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "cinder-befcd1ce-b51f-43ea-9b37-e78530a2969b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] Acquiring lock "cinder-quobyte-befcd1ce-b51f-43ea-9b37-e78530a2969b" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "cinder-quobyte-befcd1ce-b51f-43ea-9b37-e78530a2969b" acquired by "delete_volume" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:08 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f013ef59-8826-4b97-915b-6e4992a0c565]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:08 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b Sep 28 17:06:08 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:08 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b" returned: 0 in 0.570s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:08 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b Sep 28 17:06:08 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:09 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-befcd1ce-b51f-43ea-9b37-e78530a2969b" returned: 0 in 0.437s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "cinder-quobyte-befcd1ce-b51f-43ea-9b37-e78530a2969b" released by "delete_volume" :: held 1.136s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:09 devstack cinder-volume[86970]: DEBUG cinder.quota [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] Created reservations ['203c9ed0-4693-49f3-abf6-0fb6949224b8', '25b550dc-742d-45e7-b835-01d4b3da68e1', '5d8e71f7-eb37-4764-ae72-083a8baa2511', '99cf6ff5-dae6-42cf-b774-741b41643fd8'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:09 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:06:09 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:09 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.394s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:10 devstack cinder-volume[86970]: DEBUG cinder.manager [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:10 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] Deleted volume successfully. Sep 28 17:06:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-f76f7fc3-118f-41c1-8514-a4f1ef7b44e2 req-55bf8720-1c86-416b-932d-27c738d47bb1 tempest-VolumesSnapshotsTestJSON-968295704 None] Lock "cinder-befcd1ce-b51f-43ea-9b37-e78530a2969b-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Flow 'volume_create_manager' (385624f9-bbc8-4d37-b0e4-0dc7997c9eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa9b1b5d-6641-4cc6-9093-322a9941abe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa9b1b5d-6641-4cc6-9093-322a9941abe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-203647711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce8e3ff-0530-4174-a5fc-250a5aaa2ec6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d239f3111ebb49aab5d5dc88faa60333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:19Z,use_quota=True,user_id='96ac96a6127841a199d8d9174e6d7ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e80908b-7986-4b74-994e-4e43cce91bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e80908b-7986-4b74-994e-4e43cce91bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce3ac8f-c3c4-42cd-bd4d-173b917f2603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce3ac8f-c3c4-42cd-bd4d-173b917f2603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bce8e3ff-0530-4174-a5fc-250a5aaa2ec6', 'volume_name': 'volume-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17241323-5dff-4c1f-8baa-70bf072f5c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17241323-5dff-4c1f-8baa-70bf072f5c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0533fbef-f360-4602-bd54-0b441e56c022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:18 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Volume bce8e3ff-0530-4174-a5fc-250a5aaa2ec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6', 'volume_size': 1} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-203647711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce8e3ff-0530-4174-a5fc-250a5aaa2ec6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d239f3111ebb49aab5d5dc88faa60333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:19Z,use_quota=True,user_id='96ac96a6127841a199d8d9174e6d7ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Creating volume bce8e3ff-0530-4174-a5fc-250a5aaa2ec6 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:18 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:06:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:18 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6 1073741824 Sep 28 17:06:18 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:19 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6 1073741824" returned: 0 in 0.615s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:19 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6 Sep 28 17:06:19 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:19 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6" returned: 0 in 0.325s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0533fbef-f360-4602-bd54-0b441e56c022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6eb3e9-1557-44e1-b4ad-a18071971383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:19 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Volume volume-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6 (bce8e3ff-0530-4174-a5fc-250a5aaa2ec6): created successfully Sep 28 17:06:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6eb3e9-1557-44e1-b4ad-a18071971383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Flow 'volume_create_manager' (385624f9-bbc8-4d37-b0e4-0dc7997c9eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:19 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-c3f926ad-5d07-4181-890c-bbfc65ea97ec tempest-VolumesTestJSON-1398784769 None] Created volume successfully. Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Flow 'volume_create_manager' (7cf186ab-041a-439e-ab23-17797bc61dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b374f9b-7280-4357-9bad-e68fa50c65ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b374f9b-7280-4357-9bad-e68fa50c65ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-33014425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4297810-8164-4722-a7a7-55e82a784e64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d239f3111ebb49aab5d5dc88faa60333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:21Z,use_quota=True,user_id='96ac96a6127841a199d8d9174e6d7ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27ced93-be76-4158-b2ca-437797dfb933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27ced93-be76-4158-b2ca-437797dfb933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e497f5-4612-4d1e-8229-82c56ae66881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e497f5-4612-4d1e-8229-82c56ae66881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4297810-8164-4722-a7a7-55e82a784e64', 'volume_name': 'volume-b4297810-8164-4722-a7a7-55e82a784e64', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af2a992-1d1b-42db-a356-53b324eb705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af2a992-1d1b-42db-a356-53b324eb705b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df2fcb1-dff2-414a-a190-4c8e5fb0f321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:21 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Volume b4297810-8164-4722-a7a7-55e82a784e64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4297810-8164-4722-a7a7-55e82a784e64', 'volume_size': 1} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-33014425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4297810-8164-4722-a7a7-55e82a784e64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d239f3111ebb49aab5d5dc88faa60333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:21Z,use_quota=True,user_id='96ac96a6127841a199d8d9174e6d7ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Creating volume b4297810-8164-4722-a7a7-55e82a784e64 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:21 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:06:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b4297810-8164-4722-a7a7-55e82a784e64 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:21 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b4297810-8164-4722-a7a7-55e82a784e64 1073741824 Sep 28 17:06:21 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:22 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b4297810-8164-4722-a7a7-55e82a784e64 1073741824" returned: 0 in 0.563s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b4297810-8164-4722-a7a7-55e82a784e64 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:22 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b4297810-8164-4722-a7a7-55e82a784e64 Sep 28 17:06:22 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:22 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b4297810-8164-4722-a7a7-55e82a784e64" returned: 0 in 0.386s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df2fcb1-dff2-414a-a190-4c8e5fb0f321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4297810-8164-4722-a7a7-55e82a784e64', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa355307-3668-4cca-b3d9-73b0d207c0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:22 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Volume volume-b4297810-8164-4722-a7a7-55e82a784e64 (b4297810-8164-4722-a7a7-55e82a784e64): created successfully Sep 28 17:06:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa355307-3668-4cca-b3d9-73b0d207c0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Flow 'volume_create_manager' (7cf186ab-041a-439e-ab23-17797bc61dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:22 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-47be7013-eaf8-4b85-bd7c-348b00144c8d tempest-VolumesTestJSON-1398784769 None] Created volume successfully. Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=99,cinder:UPDATE=105,cinder:INSERT=27,cinder:DELETE=5 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=107,cinder:UPDATE=107,cinder:INSERT=24,cinder:DELETE=4 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Flow 'volume_create_manager' (948bf9fd-bb8f-4c0c-b002-559dc74d1180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b936504-c4c5-4b86-aed5-d391704ccc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b936504-c4c5-4b86-aed5-d391704ccc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1173468085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d92ab8f5-71ed-4b66-8f62-0ceb02eac959,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d239f3111ebb49aab5d5dc88faa60333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:24Z,use_quota=True,user_id='96ac96a6127841a199d8d9174e6d7ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65d9e29-07d7-4c9a-8f56-651304b18fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65d9e29-07d7-4c9a-8f56-651304b18fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a325f51f-d995-4126-a0f7-65d58f0755a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a325f51f-d995-4126-a0f7-65d58f0755a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd92ab8f5-71ed-4b66-8f62-0ceb02eac959', 'volume_name': 'volume-d92ab8f5-71ed-4b66-8f62-0ceb02eac959', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a43c08-b306-4e77-b7a0-55d437e132a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a43c08-b306-4e77-b7a0-55d437e132a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad251e77-1d7b-4189-9ec9-bcba5588f242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:24 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Volume d92ab8f5-71ed-4b66-8f62-0ceb02eac959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d92ab8f5-71ed-4b66-8f62-0ceb02eac959', 'volume_size': 1} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1173468085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d92ab8f5-71ed-4b66-8f62-0ceb02eac959,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d239f3111ebb49aab5d5dc88faa60333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:24Z,use_quota=True,user_id='96ac96a6127841a199d8d9174e6d7ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Creating volume d92ab8f5-71ed-4b66-8f62-0ceb02eac959 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:24 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:06:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d92ab8f5-71ed-4b66-8f62-0ceb02eac959 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:24 devstack sudo[95050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d92ab8f5-71ed-4b66-8f62-0ceb02eac959 1073741824 Sep 28 17:06:24 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:25 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d92ab8f5-71ed-4b66-8f62-0ceb02eac959 1073741824" returned: 0 in 0.642s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d92ab8f5-71ed-4b66-8f62-0ceb02eac959 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:25 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d92ab8f5-71ed-4b66-8f62-0ceb02eac959 Sep 28 17:06:25 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:25 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d92ab8f5-71ed-4b66-8f62-0ceb02eac959" returned: 0 in 0.332s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad251e77-1d7b-4189-9ec9-bcba5588f242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d92ab8f5-71ed-4b66-8f62-0ceb02eac959', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c05dd3-54ce-4051-ad09-bdcc63d7d258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:25 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Volume volume-d92ab8f5-71ed-4b66-8f62-0ceb02eac959 (d92ab8f5-71ed-4b66-8f62-0ceb02eac959): created successfully Sep 28 17:06:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c05dd3-54ce-4051-ad09-bdcc63d7d258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Flow 'volume_create_manager' (948bf9fd-bb8f-4c0c-b002-559dc74d1180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:25 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-605d3e39-a93e-48fd-9acd-e74cfa61b235 tempest-VolumesTestJSON-1398784769 None] Created volume successfully. Sep 28 17:06:26 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2186825c-b4fd-4e15-a113-c8b52f142100 tempest-GroupsTest-1252015225 None] Group tempest-Group1-138478233: creating Sep 28 17:06:26 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2186825c-b4fd-4e15-a113-c8b52f142100 tempest-GroupsTest-1252015225 None] Group tempest-Group1-138478233: created successfully Sep 28 17:06:26 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2186825c-b4fd-4e15-a113-c8b52f142100 tempest-GroupsTest-1252015225 None] Create group completed successfully. Sep 28 17:06:27 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Flow 'volume_create_manager' (3ed25c99-e15a-4cbf-b127-6d4009c766df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73829635-ed07-4c72-81a8-98ae36ac66ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73829635-ed07-4c72-81a8-98ae36ac66ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1443987504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aef2be2-6816-4c99-8e22-47aa2cbe6ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd3e6d242a741cd99c53f208ee30c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:28Z,use_quota=True,user_id='108688bc6d4e4890a293d681cc913b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (612257e0-7b75-4317-912a-ea9ac15310bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (612257e0-7b75-4317-912a-ea9ac15310bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441125a0-be3a-4a8a-b066-a02c993ff33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441125a0-be3a-4a8a-b066-a02c993ff33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aef2be2-6816-4c99-8e22-47aa2cbe6ca8', 'volume_name': 'volume-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a83723-8361-4f2b-a961-716b74ba5bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a83723-8361-4f2b-a961-716b74ba5bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02a4027-05bc-43e2-94f4-2a2ab4f55623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:27 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Volume 0aef2be2-6816-4c99-8e22-47aa2cbe6ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8', 'volume_size': 1} Sep 28 17:06:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1443987504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aef2be2-6816-4c99-8e22-47aa2cbe6ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd3e6d242a741cd99c53f208ee30c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:28Z,use_quota=True,user_id='108688bc6d4e4890a293d681cc913b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Creating volume 0aef2be2-6816-4c99-8e22-47aa2cbe6ca8 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:28 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:28 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8 1073741824 Sep 28 17:06:28 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:28 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d251d193-f8ef-47e1-b716-f53dbad15e15 tempest-GroupsTest-1252015225 None] Group tempest-Group2-3129000: creating Sep 28 17:06:28 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d251d193-f8ef-47e1-b716-f53dbad15e15 tempest-GroupsTest-1252015225 None] Group tempest-Group2-3129000: created successfully Sep 28 17:06:28 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d251d193-f8ef-47e1-b716-f53dbad15e15 tempest-GroupsTest-1252015225 None] Create group completed successfully. Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] Acquiring lock "cinder-d92ab8f5-71ed-4b66-8f62-0ceb02eac959-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] Lock "cinder-d92ab8f5-71ed-4b66-8f62-0ceb02eac959-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] Acquiring lock "cinder-quobyte-d92ab8f5-71ed-4b66-8f62-0ceb02eac959" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] Lock "cinder-quobyte-d92ab8f5-71ed-4b66-8f62-0ceb02eac959" acquired by "delete_volume" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f342bb8-3656-40f9-ac2e-9e48b024e4b3]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d92ab8f5-71ed-4b66-8f62-0ceb02eac959 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:28 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d92ab8f5-71ed-4b66-8f62-0ceb02eac959 Sep 28 17:06:28 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:28 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8 1073741824" returned: 0 in 0.590s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:28 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8 Sep 28 17:06:28 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:28 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d92ab8f5-71ed-4b66-8f62-0ceb02eac959" returned: 0 in 0.472s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d92ab8f5-71ed-4b66-8f62-0ceb02eac959 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:28 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d92ab8f5-71ed-4b66-8f62-0ceb02eac959 Sep 28 17:06:28 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:28 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8" returned: 0 in 0.318s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02a4027-05bc-43e2-94f4-2a2ab4f55623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36e6658-fbe3-478f-b880-a66720afd11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:29 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Volume volume-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8 (0aef2be2-6816-4c99-8e22-47aa2cbe6ca8): created successfully Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36e6658-fbe3-478f-b880-a66720afd11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Flow 'volume_create_manager' (3ed25c99-e15a-4cbf-b127-6d4009c766df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:29 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-61b08f07-aa74-4d00-9e06-ccdf3ab3b2a8 tempest-AttachVolumeNegativeTest-1260692363 None] Created volume successfully. Sep 28 17:06:29 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d92ab8f5-71ed-4b66-8f62-0ceb02eac959" returned: 0 in 0.313s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] Lock "cinder-quobyte-d92ab8f5-71ed-4b66-8f62-0ceb02eac959" released by "delete_volume" :: held 0.842s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] Created reservations ['0e6f4ec2-2e82-4a7e-b20f-3e2cf05ee84a', '411f4831-963b-46fb-a65f-64f59a5cdd37', 'ecb6ac1a-d0a7-4994-b57f-017b78b83449', 'a737a0b1-4370-4930-a50e-453c0293d7f3'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:29 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:06:29 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] Acquiring lock "cinder-b4297810-8164-4722-a7a7-55e82a784e64-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] Lock "cinder-b4297810-8164-4722-a7a7-55e82a784e64-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] Acquiring lock "cinder-quobyte-b4297810-8164-4722-a7a7-55e82a784e64" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] Lock "cinder-quobyte-b4297810-8164-4722-a7a7-55e82a784e64" acquired by "delete_volume" :: waited 0.035s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:29 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.420s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:29 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] Deleted volume successfully. Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7173e7c-4a9f-42e1-af29-45f01807aefd]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b4297810-8164-4722-a7a7-55e82a784e64 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-235432b1-a086-49e6-8f81-ab4d78b93c86 tempest-VolumesTestJSON-1398784769 None] Lock "cinder-d92ab8f5-71ed-4b66-8f62-0ceb02eac959-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Flow 'volume_create_manager' (947ece3c-cd75-4672-ad0c-8fc22ef5e553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:30 devstack sudo[95082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b4297810-8164-4722-a7a7-55e82a784e64 Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f05ddd5-1573-4471-8adc-242f3ad65ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:30 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f05ddd5-1573-4471-8adc-242f3ad65ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-466773342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1fb81e6-f448-4489-b2f9-f171ad5f4e39,host='devstack@QuobyteHD#QuobyteHD',id=3aed9b56-ba8e-4990-accd-d12d24eabb4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be321aa096eb447692cef231478dbca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:30Z,use_quota=True,user_id='a7a11ba8184844fab811ff73011b201c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6641259b-15e8-40ce-a693-67f3e956f3b0),volume_type_id=6641259b-15e8-40ce-a693-67f3e956f3b0)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a552e1-073c-43a2-b98a-3523ffa48a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a552e1-073c-43a2-b98a-3523ffa48a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3c623e-4a7c-4b70-8cb5-a087c054195e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3c623e-4a7c-4b70-8cb5-a087c054195e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aed9b56-ba8e-4990-accd-d12d24eabb4a', 'volume_name': 'volume-3aed9b56-ba8e-4990-accd-d12d24eabb4a', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442828fc-e775-4c26-b9be-76a0b6a7c37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442828fc-e775-4c26-b9be-76a0b6a7c37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b06498-a604-4373-962d-c3d5a919a91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:30 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Volume 3aed9b56-ba8e-4990-accd-d12d24eabb4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aed9b56-ba8e-4990-accd-d12d24eabb4a', 'volume_size': 1} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c1fb81e6-f448-4489-b2f9-f171ad5f4e39,created_at=2026-09-28T15:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-466773342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1fb81e6-f448-4489-b2f9-f171ad5f4e39,host='devstack@QuobyteHD#QuobyteHD',id=3aed9b56-ba8e-4990-accd-d12d24eabb4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be321aa096eb447692cef231478dbca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:30Z,use_quota=True,user_id='a7a11ba8184844fab811ff73011b201c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6641259b-15e8-40ce-a693-67f3e956f3b0),volume_type_id=6641259b-15e8-40ce-a693-67f3e956f3b0)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Creating volume 3aed9b56-ba8e-4990-accd-d12d24eabb4a {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:30 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3aed9b56-ba8e-4990-accd-d12d24eabb4a 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:30 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3aed9b56-ba8e-4990-accd-d12d24eabb4a 1073741824 Sep 28 17:06:30 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:30 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b4297810-8164-4722-a7a7-55e82a784e64" returned: 0 in 0.792s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b4297810-8164-4722-a7a7-55e82a784e64 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:30 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b4297810-8164-4722-a7a7-55e82a784e64 Sep 28 17:06:30 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:31 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3aed9b56-ba8e-4990-accd-d12d24eabb4a 1073741824" returned: 0 in 0.836s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3aed9b56-ba8e-4990-accd-d12d24eabb4a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:31 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3aed9b56-ba8e-4990-accd-d12d24eabb4a Sep 28 17:06:31 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:31 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b4297810-8164-4722-a7a7-55e82a784e64" returned: 0 in 0.593s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] Lock "cinder-quobyte-b4297810-8164-4722-a7a7-55e82a784e64" released by "delete_volume" :: held 1.504s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-af74accd-8949-4402-9022-1cf5e7055673 req-19af466f-2c3d-424e-83a5-cd15b5475ea3 tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] Created reservations ['e30cc74e-df2e-4286-bdc9-cf7ed8073c4e', '7a9d8651-6bc0-40d9-b769-a97d85a396d5', 'd6137fa1-cf27-4b1e-be28-35f016ec533d', '75b06ac0-0566-41a2-a29d-6c4dae0d72e3'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:31 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:06:31 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:31 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3aed9b56-ba8e-4990-accd-d12d24eabb4a" returned: 0 in 0.493s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-af74accd-8949-4402-9022-1cf5e7055673 req-19af466f-2c3d-424e-83a5-cd15b5475ea3 tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.258s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-af74accd-8949-4402-9022-1cf5e7055673 req-19af466f-2c3d-424e-83a5-cd15b5475ea3 tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b06498-a604-4373-962d-c3d5a919a91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aed9b56-ba8e-4990-accd-d12d24eabb4a', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b18415a2-af0f-4f68-93f5-50f7bfceffc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:31 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Volume volume-3aed9b56-ba8e-4990-accd-d12d24eabb4a (3aed9b56-ba8e-4990-accd-d12d24eabb4a): created successfully Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b18415a2-af0f-4f68-93f5-50f7bfceffc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Flow 'volume_create_manager' (947ece3c-cd75-4672-ad0c-8fc22ef5e553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-af74accd-8949-4402-9022-1cf5e7055673 req-19af466f-2c3d-424e-83a5-cd15b5475ea3 tempest-AttachVolumeNegativeTest-1260692363 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ceeb4a48-0275-40ef-aea7-b3c12c1aea2c', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:06:31 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1b5d65c7-7767-4c05-97ce-bd6779db6f5b tempest-GroupsTest-1252015225 None] Created volume successfully. Sep 28 17:06:31 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-af74accd-8949-4402-9022-1cf5e7055673 req-19af466f-2c3d-424e-83a5-cd15b5475ea3 tempest-AttachVolumeNegativeTest-1260692363 None] attachment_update completed successfully. Sep 28 17:06:31 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.398s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:31 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] Deleted volume successfully. Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-05919e7e-94ad-4b09-b8e1-8e631accd39b tempest-VolumesTestJSON-1398784769 None] Lock "cinder-b4297810-8164-4722-a7a7-55e82a784e64-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] Acquiring lock "cinder-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] Lock "cinder-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] Acquiring lock "cinder-quobyte-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] Lock "cinder-quobyte-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6" acquired by "delete_volume" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:32 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3e95e2-9ed8-42db-810b-3f0003e1b19a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:32 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6 Sep 28 17:06:32 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:32 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6" returned: 0 in 0.443s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:32 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6 Sep 28 17:06:32 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:32 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6" returned: 0 in 0.328s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] Lock "cinder-quobyte-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6" released by "delete_volume" :: held 0.824s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:32 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] Created reservations ['11c60aee-f527-41ff-b162-d950f4942b1b', '09f9a3f6-4590-43e8-bea8-e28c7abf3b65', 'f07b858d-cb32-4ac8-b350-4a7969d8a68b', '3a1d7389-f8e1-412c-89ff-39ec6ac70529'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:33 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:06:33 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:33 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.368s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:33 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:33 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] Deleted volume successfully. Sep 28 17:06:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0b37d677-61d8-4bab-92e6-1fb363261c16 tempest-VolumesTestJSON-1398784769 None] Lock "cinder-bce8e3ff-0530-4174-a5fc-250a5aaa2ec6-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] Acquiring lock "cinder-quobyte-3aed9b56-ba8e-4990-accd-d12d24eabb4a" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] Lock "cinder-quobyte-3aed9b56-ba8e-4990-accd-d12d24eabb4a" acquired by "delete_volume" :: waited 0.035s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:33 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[296943d0-c2a6-4808-93ef-1d6870773a32]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3aed9b56-ba8e-4990-accd-d12d24eabb4a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:34 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3aed9b56-ba8e-4990-accd-d12d24eabb4a Sep 28 17:06:34 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:34 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3aed9b56-ba8e-4990-accd-d12d24eabb4a" returned: 0 in 0.535s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3aed9b56-ba8e-4990-accd-d12d24eabb4a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:34 devstack sudo[95169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3aed9b56-ba8e-4990-accd-d12d24eabb4a Sep 28 17:06:34 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:34 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3aed9b56-ba8e-4990-accd-d12d24eabb4a" returned: 0 in 0.346s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] Lock "cinder-quobyte-3aed9b56-ba8e-4990-accd-d12d24eabb4a" released by "delete_volume" :: held 0.983s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:34 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] Created reservations ['c879bee5-1b1c-4732-9386-473633d9a66b'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:34 devstack cinder-volume[86970]: WARNING cinder.quota [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1020616436 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1020616436, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:06:34 devstack cinder-volume[86970]: WARNING cinder.quota [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1020616436 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1020616436, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:06:34 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] Created reservations ['17fcdcc2-545c-412c-a4f7-87aecfb0f180', 'b34a4253-a14a-4497-82ac-a6d1d62d0138', '88483a25-f017-4ad8-9557-5a5409c9105a', '12f2c0cd-d577-4605-854d-2118280abba7'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:35 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:06:35 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:35 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.342s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:35 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:35 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-f725ed59-14eb-4a1e-b3dd-3b3d37541e4c tempest-GroupsTest-1252015225 None] Delete group completed successfully. Sep 28 17:06:36 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-158b2708-1605-43ca-b9ab-a9c6febfb246 tempest-GroupsTest-1252015225 None] Created reservations ['16fb9ffc-810c-4d1e-90b5-7b68b3d162e8'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-158b2708-1605-43ca-b9ab-a9c6febfb246 tempest-GroupsTest-1252015225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-158b2708-1605-43ca-b9ab-a9c6febfb246 tempest-GroupsTest-1252015225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-158b2708-1605-43ca-b9ab-a9c6febfb246 tempest-GroupsTest-1252015225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-158b2708-1605-43ca-b9ab-a9c6febfb246 tempest-GroupsTest-1252015225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-158b2708-1605-43ca-b9ab-a9c6febfb246 tempest-GroupsTest-1252015225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-158b2708-1605-43ca-b9ab-a9c6febfb246 tempest-GroupsTest-1252015225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:36 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:06:36 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:36 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-158b2708-1605-43ca-b9ab-a9c6febfb246 tempest-GroupsTest-1252015225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.384s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:36 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-158b2708-1605-43ca-b9ab-a9c6febfb246 tempest-GroupsTest-1252015225 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:36 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-158b2708-1605-43ca-b9ab-a9c6febfb246 tempest-GroupsTest-1252015225 None] Delete group completed successfully. Sep 28 17:06:38 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-b87956e6-d552-4313-b23d-181520ebf84d tempest-GroupsTest-1252015225 None] Group tempest-GroupsTest-Group-422727739: creating Sep 28 17:06:38 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-b87956e6-d552-4313-b23d-181520ebf84d tempest-GroupsTest-1252015225 None] Group tempest-GroupsTest-Group-422727739: created successfully Sep 28 17:06:38 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-b87956e6-d552-4313-b23d-181520ebf84d tempest-GroupsTest-1252015225 None] Create group completed successfully. Sep 28 17:06:39 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a88a5bcb-fbea-4779-b61f-2470a09838bc tempest-GroupsV320Test-1700777029 None] Group tempest-GroupsV320Test-Group-1928036883: creating Sep 28 17:06:39 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a88a5bcb-fbea-4779-b61f-2470a09838bc tempest-GroupsV320Test-1700777029 None] Group tempest-GroupsV320Test-Group-1928036883: created successfully Sep 28 17:06:39 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a88a5bcb-fbea-4779-b61f-2470a09838bc tempest-GroupsV320Test-1700777029 None] Create group completed successfully. Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Flow 'volume_create_manager' (96adfc8c-4dc0-4322-bae0-a0445218edfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9888b6-fb83-45ee-b283-9582022da5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9888b6-fb83-45ee-b283-9582022da5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-510052369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c6dc2fc-d045-4d43-990e-d4287ae623df,host='devstack@QuobyteHD#QuobyteHD',id=d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be321aa096eb447692cef231478dbca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:40Z,use_quota=True,user_id='a7a11ba8184844fab811ff73011b201c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f61abda-cd13-4f6d-8e7f-42c11cb85d12),volume_type_id=3f61abda-cd13-4f6d-8e7f-42c11cb85d12)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c48eb88-3881-4047-9a3b-9b050882cd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c48eb88-3881-4047-9a3b-9b050882cd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23abf471-2cf4-4c99-b90a-5cc12c288fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23abf471-2cf4-4c99-b90a-5cc12c288fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0', 'volume_name': 'volume-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad50607d-25e7-411f-8305-7971e62c1e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad50607d-25e7-411f-8305-7971e62c1e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7757796-39c5-4bd1-a0a5-3d6046940a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:40 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Volume d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0', 'volume_size': 1} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c6dc2fc-d045-4d43-990e-d4287ae623df,created_at=2026-09-28T15:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-510052369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c6dc2fc-d045-4d43-990e-d4287ae623df,host='devstack@QuobyteHD#QuobyteHD',id=d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be321aa096eb447692cef231478dbca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:40Z,use_quota=True,user_id='a7a11ba8184844fab811ff73011b201c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f61abda-cd13-4f6d-8e7f-42c11cb85d12),volume_type_id=3f61abda-cd13-4f6d-8e7f-42c11cb85d12)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Creating volume d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:40 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:06:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:40 devstack sudo[95197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0 1073741824 Sep 28 17:06:40 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:41 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-568d0b66-577d-460c-96d0-ebfa7f79c6a4 tempest-GroupsV320Test-1700777029 None] Created reservations ['4ac38b50-6829-4338-9899-9387e0f580c9'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-568d0b66-577d-460c-96d0-ebfa7f79c6a4 tempest-GroupsV320Test-1700777029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-568d0b66-577d-460c-96d0-ebfa7f79c6a4 tempest-GroupsV320Test-1700777029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-568d0b66-577d-460c-96d0-ebfa7f79c6a4 tempest-GroupsV320Test-1700777029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-568d0b66-577d-460c-96d0-ebfa7f79c6a4 tempest-GroupsV320Test-1700777029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-568d0b66-577d-460c-96d0-ebfa7f79c6a4 tempest-GroupsV320Test-1700777029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-568d0b66-577d-460c-96d0-ebfa7f79c6a4 tempest-GroupsV320Test-1700777029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:41 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:06:41 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:41 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0 1073741824" returned: 0 in 1.020s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:41 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0 Sep 28 17:06:41 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:42 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-568d0b66-577d-460c-96d0-ebfa7f79c6a4 tempest-GroupsV320Test-1700777029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.353s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:42 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-568d0b66-577d-460c-96d0-ebfa7f79c6a4 tempest-GroupsV320Test-1700777029 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:42 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-568d0b66-577d-460c-96d0-ebfa7f79c6a4 tempest-GroupsV320Test-1700777029 None] Delete group completed successfully. Sep 28 17:06:42 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0" returned: 0 in 0.320s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7757796-39c5-4bd1-a0a5-3d6046940a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de20ffc2-d7bd-4727-b00d-1621f7a6b040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:42 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Volume volume-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0 (d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0): created successfully Sep 28 17:06:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de20ffc2-d7bd-4727-b00d-1621f7a6b040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Flow 'volume_create_manager' (96adfc8c-4dc0-4322-bae0-a0445218edfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:42 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-4d2d1705-3d1d-4354-a3f7-c68635e5c2b7 tempest-GroupsTest-1252015225 None] Created volume successfully. Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Flow 'volume_create_manager' (dc0507c7-0a12-4fde-a732-25f8c3db4d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3c2308-aa98-4978-a81c-525f01a3d9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3c2308-aa98-4978-a81c-525f01a3d9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1300739645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c6dc2fc-d045-4d43-990e-d4287ae623df,host='devstack@QuobyteHD#QuobyteHD',id=2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be321aa096eb447692cef231478dbca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:44Z,use_quota=True,user_id='a7a11ba8184844fab811ff73011b201c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f61abda-cd13-4f6d-8e7f-42c11cb85d12),volume_type_id=3f61abda-cd13-4f6d-8e7f-42c11cb85d12)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38fa33e3-7097-490b-b221-91a1e7b40509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38fa33e3-7097-490b-b221-91a1e7b40509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d51414f-e2f5-4c49-98f3-43a1b330e0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d51414f-e2f5-4c49-98f3-43a1b330e0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1', 'volume_name': 'volume-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5cdc16-ff48-4c06-be93-f610953f94a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5cdc16-ff48-4c06-be93-f610953f94a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75bf5a81-821a-4bef-8105-e9c0e9c2389f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:44 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Volume 2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1', 'volume_size': 1} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c6dc2fc-d045-4d43-990e-d4287ae623df,created_at=2026-09-28T15:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1300739645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c6dc2fc-d045-4d43-990e-d4287ae623df,host='devstack@QuobyteHD#QuobyteHD',id=2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be321aa096eb447692cef231478dbca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:44Z,use_quota=True,user_id='a7a11ba8184844fab811ff73011b201c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f61abda-cd13-4f6d-8e7f-42c11cb85d12),volume_type_id=3f61abda-cd13-4f6d-8e7f-42c11cb85d12)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Creating volume 2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:44 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:06:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:44 devstack sudo[95241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1 1073741824 Sep 28 17:06:44 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:45 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1 1073741824" returned: 0 in 0.860s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:45 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1 Sep 28 17:06:45 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:45 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1" returned: 0 in 0.341s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:45 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75bf5a81-821a-4bef-8105-e9c0e9c2389f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f563cd-0eb1-4f45-b5bb-08ef03eab7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:45 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Volume volume-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1 (2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1): created successfully Sep 28 17:06:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f563cd-0eb1-4f45-b5bb-08ef03eab7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Flow 'volume_create_manager' (dc0507c7-0a12-4fde-a732-25f8c3db4d03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:45 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-54d6d736-dd1e-4d58-a5d1-581ff8b1f239 tempest-GroupsTest-1252015225 None] Created volume successfully. Sep 28 17:06:47 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-f2f8479e-7622-4be4-96ba-3300bc2f3b1d tempest-GroupsTest-1252015225 None] Update group completed successfully. Sep 28 17:06:49 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-c8b268fe-2b06-428b-8088-533eae0c7e59 tempest-GroupsTest-1252015225 None] Update group completed successfully. Sep 28 17:06:51 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Acquiring lock "cinder-quobyte-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:51 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Lock "cinder-quobyte-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1" acquired by "delete_volume" :: waited 0.035s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:51 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f940d4-a754-4806-9438-e9eeecd7255d]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:51 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1 Sep 28 17:06:51 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:52 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1" returned: 0 in 0.549s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:52 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1 Sep 28 17:06:52 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:52 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1" returned: 0 in 0.341s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Lock "cinder-quobyte-2a7eff2f-53d8-4a05-b652-54dd0dbcbdd1" released by "delete_volume" :: held 0.992s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Acquiring lock "cinder-quobyte-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Lock "cinder-quobyte-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0" acquired by "delete_volume" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[892ba16e-b2f7-44b7-829a-f2d40eb60d3a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:52 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0 Sep 28 17:06:52 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Flow 'volume_create_manager' (e5caeb84-04fb-4adf-8426-e4fef6722a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01eb9dd3-15d5-4ea1-b98f-68d6660eb2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01eb9dd3-15d5-4ea1-b98f-68d6660eb2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-300007387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3754c989-ed4a-4c69-8ded-11ac520663dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7dc56b22934b12970f71a26cda167b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:53Z,use_quota=True,user_id='35f4c35033af429c99f858d3fc0ea484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53e3d22-07b7-48ad-97e0-f13154e310dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53e3d22-07b7-48ad-97e0-f13154e310dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3b00d1-521c-4e60-b875-39e032bc3be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3b00d1-521c-4e60-b875-39e032bc3be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3754c989-ed4a-4c69-8ded-11ac520663dc', 'volume_name': 'volume-3754c989-ed4a-4c69-8ded-11ac520663dc', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7267fc-174d-49d7-af05-7fc5c992c0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7267fc-174d-49d7-af05-7fc5c992c0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a39b30-82e4-46b7-8a99-eaa2774dbf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:52 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Volume 3754c989-ed4a-4c69-8ded-11ac520663dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3754c989-ed4a-4c69-8ded-11ac520663dc', 'volume_size': 1} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-300007387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3754c989-ed4a-4c69-8ded-11ac520663dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7dc56b22934b12970f71a26cda167b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:53Z,use_quota=True,user_id='35f4c35033af429c99f858d3fc0ea484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Creating volume 3754c989-ed4a-4c69-8ded-11ac520663dc {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:52 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:06:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:53 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc 1073741824 Sep 28 17:06:53 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:53 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0" returned: 0 in 0.556s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:53 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0 Sep 28 17:06:53 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:53 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0" returned: 0 in 0.328s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Lock "cinder-quobyte-d9f9aaa6-0ca1-4d1b-806e-06a4f7df61e0" released by "delete_volume" :: held 0.948s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:53 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc 1073741824" returned: 0 in 0.547s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:53 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc Sep 28 17:06:53 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:53 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Created reservations ['0f515997-e670-492c-bb72-1902fa76dce6'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:53 devstack cinder-volume[86970]: WARNING cinder.quota [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-198736256 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-198736256, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:06:53 devstack cinder-volume[86970]: WARNING cinder.quota [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-198736256 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-198736256, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:06:53 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Created reservations ['8b60002b-fb4d-4cff-a0d6-b2e32f83fe17', '19aeb764-82f0-46a6-890c-0b1922bc828e', '4b5ba6b7-4af1-4d44-a22e-29d90f032f69', '2d6ccd79-abb0-4d6b-9ba6-8b4cd29c607b'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:54 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:54 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Created reservations ['fbc4a528-065c-4664-b883-f70a20751a4a', '681ecb3e-d955-476e-80e7-a9b7b6ecc155', '5a8959ae-5e6b-4be0-9a31-3364d7a16d7e', 'c5b8a993-6365-49d2-bb3b-5f02b61876ce'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc" returned: 0 in 0.506s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a39b30-82e4-46b7-8a99-eaa2774dbf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3754c989-ed4a-4c69-8ded-11ac520663dc', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f3a3b3-4349-4c13-9cad-3c8a639cdf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:54 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Volume volume-3754c989-ed4a-4c69-8ded-11ac520663dc (3754c989-ed4a-4c69-8ded-11ac520663dc): created successfully Sep 28 17:06:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f3a3b3-4349-4c13-9cad-3c8a639cdf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Flow 'volume_create_manager' (e5caeb84-04fb-4adf-8426-e4fef6722a8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:54 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-5651c580-85ad-42e6-94b8-b0ec6ceef8c7 tempest-SnapshotsActionsTest-139603255 None] Created volume successfully. Sep 28 17:06:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:54 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:06:54 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:54 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.285s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:54 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:54 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-dc279a4a-6a7f-470a-9465-ec80c24fe8bf tempest-GroupsTest-1252015225 None] Delete group completed successfully. Sep 28 17:06:55 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-b4140ec5-a700-4920-96e5-4e73754db4f4 req-76a9dd14-36db-42c8-a041-77809e7b5dcd tempest-AttachVolumeTestJSON-1953796176 None] Terminate volume connection completed successfully. Sep 28 17:06:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-b4140ec5-a700-4920-96e5-4e73754db4f4 req-76a9dd14-36db-42c8-a041-77809e7b5dcd tempest-AttachVolumeTestJSON-1953796176 None] Deleting attachment b8ea61af-846c-4dab-829d-8a5db00a33d6. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:06:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] Creating offline snapshot 5535c061-b871-494e-93fe-8cb49e0273b0 of volume 3754c989-ed4a-4c69-8ded-11ac520663dc {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:06:55 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32af9e8-50e8-43f2-8a79-11f10245b0c2]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:55 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc Sep 28 17:06:55 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:55 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc" returned: 0 in 0.631s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:56 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 1G Sep 28 17:06:56 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:56 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 1G" returned: 0 in 0.810s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3754c989-ed4a-4c69-8ded-11ac520663dc -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:56 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3754c989-ed4a-4c69-8ded-11ac520663dc -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 Sep 28 17:06:56 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:57 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3754c989-ed4a-4c69-8ded-11ac520663dc -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0" returned: 0 in 0.395s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:57 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 is being set with open permissions: ugo+rw Sep 28 17:06:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:57 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 Sep 28 17:06:57 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:57 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0" returned: 0 in 0.355s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:57 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.info Sep 28 17:06:57 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:58 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.info" returned: 0 in 0.404s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:58 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.info is being set with open permissions: ugo+rw Sep 28 17:06:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:58 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.info Sep 28 17:06:58 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:58 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.info" returned: 0 in 0.477s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.244s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:58 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-70fbd360-274e-44c9-84f3-587ada0119ec tempest-SnapshotsActionsTest-139603255 None] Create snapshot completed successfully Sep 28 17:07:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:07:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.097s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:01 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:07:01 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ec2198dd-52de-4068-8cdf-9e7862454a0d tempest-SnapshotsActionsTest-139603255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ec2198dd-52de-4068-8cdf-9e7862454a0d tempest-SnapshotsActionsTest-139603255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ec2198dd-52de-4068-8cdf-9e7862454a0d tempest-SnapshotsActionsTest-139603255 None] Creating offline snapshot 234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9 of volume 3754c989-ed4a-4c69-8ded-11ac520663dc {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:07:01 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7263eef-c9b8-40e1-8986-b4324f0c13f1]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec2198dd-52de-4068-8cdf-9e7862454a0d tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:01 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.799s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:02 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:07:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:07:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:07:02 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 Sep 28 17:07:02 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:02 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec2198dd-52de-4068-8cdf-9e7862454a0d tempest-SnapshotsActionsTest-139603255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0" returned: 0 in 0.994s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ec2198dd-52de-4068-8cdf-9e7862454a0d tempest-SnapshotsActionsTest-139603255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3754c989-ed4a-4c69-8ded-11ac520663dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec2198dd-52de-4068-8cdf-9e7862454a0d tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:02 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9 1G Sep 28 17:07:02 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:03 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec2198dd-52de-4068-8cdf-9e7862454a0d tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9 1G" returned: 0 in 0.747s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec2198dd-52de-4068-8cdf-9e7862454a0d tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:03 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9 Sep 28 17:07:03 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:03 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec2198dd-52de-4068-8cdf-9e7862454a0d tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9" returned: 0 in 0.471s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:03 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-ec2198dd-52de-4068-8cdf-9e7862454a0d tempest-SnapshotsActionsTest-139603255 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9 is being set with open permissions: ugo+rw Sep 28 17:07:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec2198dd-52de-4068-8cdf-9e7862454a0d tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:03 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9 Sep 28 17:07:03 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:04 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec2198dd-52de-4068-8cdf-9e7862454a0d tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9" returned: 0 in 0.351s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ec2198dd-52de-4068-8cdf-9e7862454a0d tempest-SnapshotsActionsTest-139603255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.923s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:04 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ec2198dd-52de-4068-8cdf-9e7862454a0d tempest-SnapshotsActionsTest-139603255 None] Create snapshot completed successfully Sep 28 17:07:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Acquiring lock "cinder-234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Acquiring lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Acquiring lock "cinder-quobyte-234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-quobyte-234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Deleting offline snapshot 234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9 of volume 3754c989-ed4a-4c69-8ded-11ac520663dc {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:07:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] snapshot_file for this snap is: volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:07:05 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[717b660f-13c1-46f7-9cc9-42cf9673ebb6]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:05 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9 Sep 28 17:07:05 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:06 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9" returned: 0 in 0.468s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3754c989-ed4a-4c69-8ded-11ac520663dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:06 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[4680ebbd-4dc3-4ae3-887d-62f3fb9323ac]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:06 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 Sep 28 17:07:06 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:06 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0" returned: 0 in 0.537s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3754c989-ed4a-4c69-8ded-11ac520663dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:06 devstack sudo[95581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9 Sep 28 17:07:06 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:06 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:07:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Flow 'volume_create_manager' (2aedf163-98bf-4077-b97b-1f22ebd13e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c31d79c-8fae-47a7-9a09-e384532ac747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c31d79c-8fae-47a7-9a09-e384532ac747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1153778960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45959321-a727-420b-a801-8128d44f1d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5f81f7f6d14871817b4a17060deb41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:07Z,use_quota=True,user_id='055408f5eae74e4ca8a9513e75fd203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028e0e2f-8564-4240-83ba-0f3c0143c035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028e0e2f-8564-4240-83ba-0f3c0143c035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30fb3ae4-f520-4ea5-9e45-c903d1e4a3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30fb3ae4-f520-4ea5-9e45-c903d1e4a3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45959321-a727-420b-a801-8128d44f1d8c', 'volume_name': 'volume-45959321-a727-420b-a801-8128d44f1d8c', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d048b9d5-81b7-40ce-9b80-d6239c2a28a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d048b9d5-81b7-40ce-9b80-d6239c2a28a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8273d70-270b-4dcc-8b30-6d0519f97df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:07 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Volume 45959321-a727-420b-a801-8128d44f1d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45959321-a727-420b-a801-8128d44f1d8c', 'volume_size': 1} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1153778960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45959321-a727-420b-a801-8128d44f1d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5f81f7f6d14871817b4a17060deb41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:07Z,use_quota=True,user_id='055408f5eae74e4ca8a9513e75fd203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Creating volume 45959321-a727-420b-a801-8128d44f1d8c {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:07:07 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-45959321-a727-420b-a801-8128d44f1d8c 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:07 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-45959321-a727-420b-a801-8128d44f1d8c 1073741824 Sep 28 17:07:07 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:07 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9" returned: 0 in 0.462s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:07 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9 Sep 28 17:07:07 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:07 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-45959321-a727-420b-a801-8128d44f1d8c 1073741824" returned: 0 in 0.550s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-45959321-a727-420b-a801-8128d44f1d8c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:07 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9" returned: 0 in 0.335s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:07 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-45959321-a727-420b-a801-8128d44f1d8c Sep 28 17:07:07 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-quobyte-234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9" released by "_delete_snapshot" :: held 1.966s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" released by "delete_snapshot" :: held 2.009s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Created reservations ['ec46bb23-5c6e-4d14-a974-0e805902173d', '8836478f-3f67-460f-addd-99ac0b3008f0', '1960d8fb-74d5-42bf-a194-7ad04ded201d', 'cd960658-3fbf-4b2e-90bc-84efa9486731'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:07 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Delete snapshot completed successfully. Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e050df51-9256-44b1-aa6d-43ff9caea30d tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-234386c4-ec7d-4bd6-94d9-9bda8ca5c7e9-delete_snapshot" released by "delete_snapshot" :: held 2.292s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:07 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-45959321-a727-420b-a801-8128d44f1d8c" returned: 0 in 0.361s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8273d70-270b-4dcc-8b30-6d0519f97df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45959321-a727-420b-a801-8128d44f1d8c', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1061ac8-5ee8-424c-aba1-b77f784fbc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:08 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Volume volume-45959321-a727-420b-a801-8128d44f1d8c (45959321-a727-420b-a801-8128d44f1d8c): created successfully Sep 28 17:07:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1061ac8-5ee8-424c-aba1-b77f784fbc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Flow 'volume_create_manager' (2aedf163-98bf-4077-b97b-1f22ebd13e0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:08 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a6f09157-45d7-40aa-88f3-28b366097048 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Created volume successfully. Sep 28 17:07:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1f7a22c9-a7cf-4b2c-ae00-118bdf5eda11 tempest-SnapshotsActionsTest-139603255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1f7a22c9-a7cf-4b2c-ae00-118bdf5eda11 tempest-SnapshotsActionsTest-139603255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1f7a22c9-a7cf-4b2c-ae00-118bdf5eda11 tempest-SnapshotsActionsTest-139603255 None] Creating offline snapshot f48d7f34-c778-4e84-a6fc-7dec258affcb of volume 3754c989-ed4a-4c69-8ded-11ac520663dc {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:07:09 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[a431d758-8d17-4c93-a599-c12d2e6c6c44]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1f7a22c9-a7cf-4b2c-ae00-118bdf5eda11 tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:09 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 Sep 28 17:07:09 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:10 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1f7a22c9-a7cf-4b2c-ae00-118bdf5eda11 tempest-SnapshotsActionsTest-139603255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0" returned: 0 in 0.580s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1f7a22c9-a7cf-4b2c-ae00-118bdf5eda11 tempest-SnapshotsActionsTest-139603255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3754c989-ed4a-4c69-8ded-11ac520663dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1f7a22c9-a7cf-4b2c-ae00-118bdf5eda11 tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:10 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb 1G Sep 28 17:07:10 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Acquiring lock "cinder-45959321-a727-420b-a801-8128d44f1d8c-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Lock "cinder-45959321-a727-420b-a801-8128d44f1d8c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:10 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1f7a22c9-a7cf-4b2c-ae00-118bdf5eda11 tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb 1G" returned: 0 in 0.741s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1f7a22c9-a7cf-4b2c-ae00-118bdf5eda11 tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Acquiring lock "cinder-quobyte-45959321-a727-420b-a801-8128d44f1d8c" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:10 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb Sep 28 17:07:10 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Lock "cinder-quobyte-45959321-a727-420b-a801-8128d44f1d8c" acquired by "delete_volume" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:10 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cd9b0c-e6fc-4c73-bfeb-62815ab66040]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-45959321-a727-420b-a801-8128d44f1d8c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:11 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-45959321-a727-420b-a801-8128d44f1d8c Sep 28 17:07:11 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:11 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1f7a22c9-a7cf-4b2c-ae00-118bdf5eda11 tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb" returned: 0 in 0.475s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:11 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-1f7a22c9-a7cf-4b2c-ae00-118bdf5eda11 tempest-SnapshotsActionsTest-139603255 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb is being set with open permissions: ugo+rw Sep 28 17:07:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1f7a22c9-a7cf-4b2c-ae00-118bdf5eda11 tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:11 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb Sep 28 17:07:11 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:11 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-45959321-a727-420b-a801-8128d44f1d8c" returned: 0 in 0.696s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-45959321-a727-420b-a801-8128d44f1d8c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:11 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-45959321-a727-420b-a801-8128d44f1d8c Sep 28 17:07:11 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:11 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1f7a22c9-a7cf-4b2c-ae00-118bdf5eda11 tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb" returned: 0 in 0.371s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1f7a22c9-a7cf-4b2c-ae00-118bdf5eda11 tempest-SnapshotsActionsTest-139603255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.365s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:11 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1f7a22c9-a7cf-4b2c-ae00-118bdf5eda11 tempest-SnapshotsActionsTest-139603255 None] Create snapshot completed successfully Sep 28 17:07:12 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-45959321-a727-420b-a801-8128d44f1d8c" returned: 0 in 0.614s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:12 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Lock "cinder-quobyte-45959321-a727-420b-a801-8128d44f1d8c" released by "delete_volume" :: held 1.387s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:12 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Created reservations ['ff76b2a0-710b-4aeb-a964-4005ac7a539d', '51510572-a9b4-470e-bf22-6d3abfa64438', 'd68049e3-3f7b-472d-82ee-865b81b8544e', 'b918f9c8-6af0-432f-88c6-c75b70ef3f98'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:12 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:07:12 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Acquiring lock "cinder-f48d7f34-c778-4e84-a6fc-7dec258affcb-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-f48d7f34-c778-4e84-a6fc-7dec258affcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Acquiring lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Acquiring lock "cinder-quobyte-f48d7f34-c778-4e84-a6fc-7dec258affcb" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-quobyte-f48d7f34-c778-4e84-a6fc-7dec258affcb" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:13 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Deleting offline snapshot f48d7f34-c778-4e84-a6fc-7dec258affcb of volume 3754c989-ed4a-4c69-8ded-11ac520663dc {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:07:13 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] snapshot_file for this snap is: volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:07:13 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.538s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:13 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:13 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3cda76-019a-44d0-ab93-da51406ab940]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:13 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Deleted volume successfully. Sep 28 17:07:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-deacf307-2540-414f-9279-c45810efad62 tempest-VolumeQuotasNegativeTestJSON-1215718039 None] Lock "cinder-45959321-a727-420b-a801-8128d44f1d8c-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:13 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb Sep 28 17:07:13 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:13 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb" returned: 0 in 0.587s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:13 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3754c989-ed4a-4c69-8ded-11ac520663dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:13 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[905c5bef-1e07-4a2c-ab43-2348dbad0004]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:14 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 Sep 28 17:07:14 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:14 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0" returned: 0 in 0.648s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:14 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3754c989-ed4a-4c69-8ded-11ac520663dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:14 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb Sep 28 17:07:14 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:15 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb" returned: 0 in 0.666s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:15 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb Sep 28 17:07:15 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:15 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.f48d7f34-c778-4e84-a6fc-7dec258affcb" returned: 0 in 0.366s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-quobyte-f48d7f34-c778-4e84-a6fc-7dec258affcb" released by "_delete_snapshot" :: held 2.472s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" released by "delete_snapshot" :: held 2.518s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:15 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Created reservations ['9171a8f8-7c23-4f87-9473-35b6ce54b998', '1e0e6138-f5c5-4d2b-83ba-edadd14d72b5', '8eab6140-8098-42b0-a84e-4b5e23ec7233', '360a8223-1a10-4def-9ce2-d4f8a06f12d0'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:15 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Delete snapshot completed successfully. Sep 28 17:07:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d33372cc-2c35-4aa4-9d2f-e26ed4c915da tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-f48d7f34-c778-4e84-a6fc-7dec258affcb-delete_snapshot" released by "delete_snapshot" :: held 2.802s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7acda490-3b07-4493-9402-a48a0c828101 tempest-SnapshotsActionsTest-139603255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7acda490-3b07-4493-9402-a48a0c828101 tempest-SnapshotsActionsTest-139603255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-7acda490-3b07-4493-9402-a48a0c828101 tempest-SnapshotsActionsTest-139603255 None] Creating offline snapshot 93876479-efb0-47a9-9e81-1234a854fcf1 of volume 3754c989-ed4a-4c69-8ded-11ac520663dc {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:07:17 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fabc96-8669-4f95-800d-b60bd6c3cdc1]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7acda490-3b07-4493-9402-a48a0c828101 tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:17 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 Sep 28 17:07:17 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:17 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7acda490-3b07-4493-9402-a48a0c828101 tempest-SnapshotsActionsTest-139603255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0" returned: 0 in 0.655s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-7acda490-3b07-4493-9402-a48a0c828101 tempest-SnapshotsActionsTest-139603255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3754c989-ed4a-4c69-8ded-11ac520663dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7acda490-3b07-4493-9402-a48a0c828101 tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:17 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1 1G Sep 28 17:07:17 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:18 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7acda490-3b07-4493-9402-a48a0c828101 tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1 1G" returned: 0 in 0.861s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7acda490-3b07-4493-9402-a48a0c828101 tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:18 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1 Sep 28 17:07:18 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:18 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-f8e006b3-1254-4233-a7d7-b57dec96f7d1 req-5f8493ac-eda1-4d26-8023-2051afe3f90a tempest-AttachVolumeNegativeTest-1260692363 None] Terminate volume connection completed successfully. Sep 28 17:07:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-f8e006b3-1254-4233-a7d7-b57dec96f7d1 req-5f8493ac-eda1-4d26-8023-2051afe3f90a tempest-AttachVolumeNegativeTest-1260692363 None] Deleting attachment ceeb4a48-0275-40ef-aea7-b3c12c1aea2c. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:07:19 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7acda490-3b07-4493-9402-a48a0c828101 tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1" returned: 0 in 0.500s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:19 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-7acda490-3b07-4493-9402-a48a0c828101 tempest-SnapshotsActionsTest-139603255 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1 is being set with open permissions: ugo+rw Sep 28 17:07:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7acda490-3b07-4493-9402-a48a0c828101 tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:19 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1 Sep 28 17:07:19 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:19 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7acda490-3b07-4493-9402-a48a0c828101 tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1" returned: 0 in 0.348s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7acda490-3b07-4493-9402-a48a0c828101 tempest-SnapshotsActionsTest-139603255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.596s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:19 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-7acda490-3b07-4493-9402-a48a0c828101 tempest-SnapshotsActionsTest-139603255 None] Create snapshot completed successfully Sep 28 17:07:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Acquiring lock "cinder-93876479-efb0-47a9-9e81-1234a854fcf1-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-93876479-efb0-47a9-9e81-1234a854fcf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Acquiring lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Acquiring lock "cinder-quobyte-93876479-efb0-47a9-9e81-1234a854fcf1" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-quobyte-93876479-efb0-47a9-9e81-1234a854fcf1" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Deleting offline snapshot 93876479-efb0-47a9-9e81-1234a854fcf1 of volume 3754c989-ed4a-4c69-8ded-11ac520663dc {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:07:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] snapshot_file for this snap is: volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:07:20 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7596277-6102-4a10-91e4-f04103d9f6f6]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:20 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1 Sep 28 17:07:20 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:20 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1" returned: 0 in 0.593s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3754c989-ed4a-4c69-8ded-11ac520663dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:21 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaac716b-b17a-488d-8f55-d52bdaf4dc8a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:21 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 Sep 28 17:07:21 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:21 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0" returned: 0 in 0.567s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3754c989-ed4a-4c69-8ded-11ac520663dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:21 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1 Sep 28 17:07:21 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:22 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1" returned: 0 in 0.560s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:22 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1 Sep 28 17:07:22 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:22 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.93876479-efb0-47a9-9e81-1234a854fcf1" returned: 0 in 0.310s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-quobyte-93876479-efb0-47a9-9e81-1234a854fcf1" released by "_delete_snapshot" :: held 2.184s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" released by "delete_snapshot" :: held 2.218s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:22 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Created reservations ['da5501fe-f777-428d-9155-b60917daa701', '3c8de52f-52aa-451d-b88b-bb9969ba4f9b', 'c753412d-d3d5-4bed-88d8-1c0ef09e49ed', '224e7604-5cf7-4735-8490-e8d7c453eef1'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:22 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Delete snapshot completed successfully. Sep 28 17:07:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9d54b244-ffc3-4c31-9052-ee02ace0575e tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-93876479-efb0-47a9-9e81-1234a854fcf1-delete_snapshot" released by "delete_snapshot" :: held 2.389s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ae10b186-b463-4296-9e38-d4f588c46bcf tempest-SnapshotsActionsTest-139603255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ae10b186-b463-4296-9e38-d4f588c46bcf tempest-SnapshotsActionsTest-139603255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ae10b186-b463-4296-9e38-d4f588c46bcf tempest-SnapshotsActionsTest-139603255 None] Creating offline snapshot 596d592b-9b0e-4533-961c-695d734c326a of volume 3754c989-ed4a-4c69-8ded-11ac520663dc {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:07:24 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deebab8-8559-4d37-83bd-335107ef953a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ae10b186-b463-4296-9e38-d4f588c46bcf tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:24 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 Sep 28 17:07:24 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:24 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ae10b186-b463-4296-9e38-d4f588c46bcf tempest-SnapshotsActionsTest-139603255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0" returned: 0 in 0.509s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ae10b186-b463-4296-9e38-d4f588c46bcf tempest-SnapshotsActionsTest-139603255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3754c989-ed4a-4c69-8ded-11ac520663dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ae10b186-b463-4296-9e38-d4f588c46bcf tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:24 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a 1G Sep 28 17:07:24 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:25 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ae10b186-b463-4296-9e38-d4f588c46bcf tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a 1G" returned: 0 in 0.789s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ae10b186-b463-4296-9e38-d4f588c46bcf tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:25 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a Sep 28 17:07:25 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:25 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ae10b186-b463-4296-9e38-d4f588c46bcf tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a" returned: 0 in 0.435s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:25 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-ae10b186-b463-4296-9e38-d4f588c46bcf tempest-SnapshotsActionsTest-139603255 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a is being set with open permissions: ugo+rw Sep 28 17:07:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ae10b186-b463-4296-9e38-d4f588c46bcf tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:25 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a Sep 28 17:07:25 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:26 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ae10b186-b463-4296-9e38-d4f588c46bcf tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a" returned: 0 in 0.380s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:26 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=102,cinder:INSERT=27,cinder:UPDATE=123,cinder:DELETE=10 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:07:26 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=118,cinder:UPDATE=108,cinder:INSERT=25,cinder:DELETE=5 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:07:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ae10b186-b463-4296-9e38-d4f588c46bcf tempest-SnapshotsActionsTest-139603255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:26 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ae10b186-b463-4296-9e38-d4f588c46bcf tempest-SnapshotsActionsTest-139603255 None] Create snapshot completed successfully Sep 28 17:07:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Acquiring lock "cinder-596d592b-9b0e-4533-961c-695d734c326a-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-596d592b-9b0e-4533-961c-695d734c326a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Acquiring lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Acquiring lock "cinder-quobyte-596d592b-9b0e-4533-961c-695d734c326a" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-quobyte-596d592b-9b0e-4533-961c-695d734c326a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Deleting offline snapshot 596d592b-9b0e-4533-961c-695d734c326a of volume 3754c989-ed4a-4c69-8ded-11ac520663dc {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:07:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] snapshot_file for this snap is: volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:07:27 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[1add4cec-b05d-4a91-9e4c-90e1d8f50a58]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:27 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a Sep 28 17:07:27 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:28 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a" returned: 0 in 0.573s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3754c989-ed4a-4c69-8ded-11ac520663dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:28 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6a0363-16dd-4625-8d6e-dc64972b1b8a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:28 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 Sep 28 17:07:28 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:28 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0" returned: 0 in 0.785s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3754c989-ed4a-4c69-8ded-11ac520663dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:28 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a Sep 28 17:07:28 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:29 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a" returned: 0 in 0.542s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:29 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a Sep 28 17:07:29 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:29 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.596d592b-9b0e-4533-961c-695d734c326a" returned: 0 in 0.453s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-quobyte-596d592b-9b0e-4533-961c-695d734c326a" released by "_delete_snapshot" :: held 2.542s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" released by "delete_snapshot" :: held 2.584s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:30 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Created reservations ['d541d96a-4f81-4d5c-a711-d37dceda91c4', '774b954a-f1bc-4ae3-af43-26f3cb11041e', 'c2a47311-c620-4f98-acc4-84226a86dc13', 'abe476bf-ba95-42c8-9190-f2fb2ca3fc36'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:30 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Delete snapshot completed successfully. Sep 28 17:07:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-79e7e854-20f8-462a-8a82-4e7d9685bc24 tempest-SnapshotsActionsTest-1744269835 None] Lock "cinder-596d592b-9b0e-4533-961c-695d734c326a-delete_snapshot" released by "delete_snapshot" :: held 2.805s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] Acquiring lock "cinder-5535c061-b871-494e-93fe-8cb49e0273b0-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] Lock "cinder-5535c061-b871-494e-93fe-8cb49e0273b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] Acquiring lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] Lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] Acquiring lock "cinder-quobyte-5535c061-b871-494e-93fe-8cb49e0273b0" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] Lock "cinder-quobyte-5535c061-b871-494e-93fe-8cb49e0273b0" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] Deleting offline snapshot 5535c061-b871-494e-93fe-8cb49e0273b0 of volume 3754c989-ed4a-4c69-8ded-11ac520663dc {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:07:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] snapshot_file for this snap is: volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:07:31 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddfefbf-ccf3-4199-a5a5-b51555988f4a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:31 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 Sep 28 17:07:31 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:32 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0" returned: 0 in 0.787s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3754c989-ed4a-4c69-8ded-11ac520663dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3b5b52-5afe-4653-a3bb-d11f725a7d17]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:32 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc Sep 28 17:07:32 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Flow 'volume_create_manager' (b0e433e6-240c-4a76-9634-9380b87e4a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833579f1-96dd-45ae-869d-025a472397b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833579f1-96dd-45ae-869d-025a472397b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1059348531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b5bcdd-05b6-44e5-ad12-96c38c6bf167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f899c9b9b3e94eef9aa313cf964103fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:33Z,use_quota=True,user_id='9e79fc0f6f15411ea3307f40c0f17fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffde0a38-2775-42b8-bb64-bcb88902461f),volume_type_id=ffde0a38-2775-42b8-bb64-bcb88902461f)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95233738-2d0f-4fe6-951e-818c799f1b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95233738-2d0f-4fe6-951e-818c799f1b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5cca95-69ca-48e1-a70c-85b402c3def4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5cca95-69ca-48e1-a70c-85b402c3def4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b5bcdd-05b6-44e5-ad12-96c38c6bf167', 'volume_name': 'volume-48b5bcdd-05b6-44e5-ad12-96c38c6bf167', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432f41ae-18eb-4b97-95d4-7d0a6eb552c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432f41ae-18eb-4b97-95d4-7d0a6eb552c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06fe23c2-899a-4cc8-ae2b-570c02a3f5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:32 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Volume 48b5bcdd-05b6-44e5-ad12-96c38c6bf167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b5bcdd-05b6-44e5-ad12-96c38c6bf167', 'volume_size': 1} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1059348531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b5bcdd-05b6-44e5-ad12-96c38c6bf167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f899c9b9b3e94eef9aa313cf964103fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:33Z,use_quota=True,user_id='9e79fc0f6f15411ea3307f40c0f17fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffde0a38-2775-42b8-bb64-bcb88902461f),volume_type_id=ffde0a38-2775-42b8-bb64-bcb88902461f)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Creating volume 48b5bcdd-05b6-44e5-ad12-96c38c6bf167 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:07:32 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:07:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-48b5bcdd-05b6-44e5-ad12-96c38c6bf167 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:33 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-48b5bcdd-05b6-44e5-ad12-96c38c6bf167 1073741824 Sep 28 17:07:33 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:33 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc" returned: 0 in 0.797s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:33 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 Sep 28 17:07:33 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:33 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-48b5bcdd-05b6-44e5-ad12-96c38c6bf167 1073741824" returned: 0 in 0.670s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-48b5bcdd-05b6-44e5-ad12-96c38c6bf167 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:33 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-48b5bcdd-05b6-44e5-ad12-96c38c6bf167 Sep 28 17:07:33 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:33 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0" returned: 0 in 0.589s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:33 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0 Sep 28 17:07:33 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:34 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-48b5bcdd-05b6-44e5-ad12-96c38c6bf167" returned: 0 in 0.372s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:34 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:07:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06fe23c2-899a-4cc8-ae2b-570c02a3f5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b5bcdd-05b6-44e5-ad12-96c38c6bf167', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cb4c5e-36a8-4273-b5b6-543304c9255d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:34 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Volume volume-48b5bcdd-05b6-44e5-ad12-96c38c6bf167 (48b5bcdd-05b6-44e5-ad12-96c38c6bf167): created successfully Sep 28 17:07:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cb4c5e-36a8-4273-b5b6-543304c9255d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Flow 'volume_create_manager' (b0e433e6-240c-4a76-9634-9380b87e4a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:34 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-c9bf59b7-7b67-4dc8-82c4-f807602b3ba4 tempest-VolumeTypesAccessTest-1512312606 None] Created volume successfully. Sep 28 17:07:34 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc.5535c061-b871-494e-93fe-8cb49e0273b0" returned: 0 in 0.358s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] Lock "cinder-quobyte-5535c061-b871-494e-93fe-8cb49e0273b0" released by "_delete_snapshot" :: held 2.727s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] Lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" released by "delete_snapshot" :: held 2.768s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:34 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] Created reservations ['0ae5b9c2-13a6-46be-b897-0da66fc32b09', '26861eb0-8bd1-4194-b34b-c9d7c1cbfd64', '1461822e-ad7f-4607-8536-8adfbc8b7860', '74ef5681-0885-4fae-ba0b-a9c875aee041'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:34 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] Delete snapshot completed successfully. Sep 28 17:07:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fc8058aa-4956-4423-8331-6532cbb2eeb5 tempest-SnapshotsActionsTest-139603255 None] Lock "cinder-5535c061-b871-494e-93fe-8cb49e0273b0-delete_snapshot" released by "delete_snapshot" :: held 2.954s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Acquiring lock "cinder-48b5bcdd-05b6-44e5-ad12-96c38c6bf167-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Lock "cinder-48b5bcdd-05b6-44e5-ad12-96c38c6bf167-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] Acquiring lock "cinder-3754c989-ed4a-4c69-8ded-11ac520663dc-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Acquiring lock "cinder-quobyte-48b5bcdd-05b6-44e5-ad12-96c38c6bf167" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] Lock "cinder-3754c989-ed4a-4c69-8ded-11ac520663dc-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Lock "cinder-quobyte-48b5bcdd-05b6-44e5-ad12-96c38c6bf167" acquired by "delete_volume" :: waited 0.058s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:35 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3c7c30-dde5-4575-89ab-e0417c3f38d7]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-48b5bcdd-05b6-44e5-ad12-96c38c6bf167 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] Acquiring lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] Lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" acquired by "delete_volume" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:35 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac3d989-ea13-4a99-be0f-40d685e01208]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:35 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-48b5bcdd-05b6-44e5-ad12-96c38c6bf167 Sep 28 17:07:35 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:35 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc Sep 28 17:07:35 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:35 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-48b5bcdd-05b6-44e5-ad12-96c38c6bf167" returned: 0 in 0.509s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-48b5bcdd-05b6-44e5-ad12-96c38c6bf167 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:35 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-48b5bcdd-05b6-44e5-ad12-96c38c6bf167 Sep 28 17:07:35 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:35 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc" returned: 0 in 0.658s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:36 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc Sep 28 17:07:36 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:36 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-48b5bcdd-05b6-44e5-ad12-96c38c6bf167" returned: 0 in 0.467s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Lock "cinder-quobyte-48b5bcdd-05b6-44e5-ad12-96c38c6bf167" released by "delete_volume" :: held 1.076s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:36 devstack cinder-volume[86970]: WARNING cinder.quota [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1563822449 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1563822449, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:07:36 devstack cinder-volume[86970]: WARNING cinder.quota [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1563822449 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1563822449, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Created reservations ['815564a2-f598-4f21-ab91-d513ef2e2887', 'a726c0d6-a8e4-43ef-acc2-8d0eb0b1bf51', '47abffde-bef0-402a-acdf-88e8de333423', 'efa939e9-7604-440c-9bc7-401b407e74ec'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:36 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3754c989-ed4a-4c69-8ded-11ac520663dc" returned: 0 in 0.544s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] Lock "cinder-quobyte-3754c989-ed4a-4c69-8ded-11ac520663dc" released by "delete_volume" :: held 1.321s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:36 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:07:36 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] Created reservations ['06fe00fb-f35e-494e-8364-65d68edcf9d9', 'ff47cfc4-2393-45d9-9a3c-c6f6c59cfee3', 'e711074d-3585-4cc4-b97c-0e630099e6bd', 'bbbd6890-a6ba-498a-bf7e-c14d29a75fb2'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:37 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:07:37 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:37 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.564s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:37 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:37 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Deleted volume successfully. Sep 28 17:07:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a7855218-9fb0-46b7-9ff7-686340055eaa tempest-VolumeTypesAccessTest-1512312606 None] Lock "cinder-48b5bcdd-05b6-44e5-ad12-96c38c6bf167-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:37 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.799s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:37 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:37 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] Deleted volume successfully. Sep 28 17:07:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8d267bc3-bc5b-4872-b7b2-4b4c0ad3a4df tempest-SnapshotsActionsTest-139603255 None] Lock "cinder-3754c989-ed4a-4c69-8ded-11ac520663dc-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:47 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=23,cinder:INSERT=9,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:07:47 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=22,cinder:UPDATE=35,cinder:DELETE=2,cinder:INSERT=8 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:08:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:08:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:01 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:08:01 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:01 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.666s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:08:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:08:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Flow 'volume_create_manager' (0044c343-bef6-4848-b250-73c37872bef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f817ac4d-3fd2-4671-ad82-28c2737ed577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f817ac4d-3fd2-4671-ad82-28c2737ed577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1300460484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94c8918-6afb-43e6-8d61-c0dcafa4d338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd3e6d242a741cd99c53f208ee30c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:08Z,use_quota=True,user_id='108688bc6d4e4890a293d681cc913b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530eb6fb-7c0d-4f4f-bf8d-c1a58a25eefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530eb6fb-7c0d-4f4f-bf8d-c1a58a25eefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ab7424-4005-44dc-b011-fba19e199a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ab7424-4005-44dc-b011-fba19e199a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a94c8918-6afb-43e6-8d61-c0dcafa4d338', 'volume_name': 'volume-a94c8918-6afb-43e6-8d61-c0dcafa4d338', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0485ab37-4f1e-41da-8dc1-6925eb82c967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0485ab37-4f1e-41da-8dc1-6925eb82c967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb91863f-c835-4a3b-875e-f633df060f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:08 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Volume a94c8918-6afb-43e6-8d61-c0dcafa4d338: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a94c8918-6afb-43e6-8d61-c0dcafa4d338', 'volume_size': 1} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1300460484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94c8918-6afb-43e6-8d61-c0dcafa4d338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd3e6d242a741cd99c53f208ee30c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:08Z,use_quota=True,user_id='108688bc6d4e4890a293d681cc913b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Creating volume a94c8918-6afb-43e6-8d61-c0dcafa4d338 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:08 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:08:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a94c8918-6afb-43e6-8d61-c0dcafa4d338 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:08 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a94c8918-6afb-43e6-8d61-c0dcafa4d338 1073741824 Sep 28 17:08:08 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:09 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a94c8918-6afb-43e6-8d61-c0dcafa4d338 1073741824" returned: 0 in 0.829s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a94c8918-6afb-43e6-8d61-c0dcafa4d338 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:09 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a94c8918-6afb-43e6-8d61-c0dcafa4d338 Sep 28 17:08:09 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:09 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a94c8918-6afb-43e6-8d61-c0dcafa4d338" returned: 0 in 0.533s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb91863f-c835-4a3b-875e-f633df060f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a94c8918-6afb-43e6-8d61-c0dcafa4d338', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d5b12e-8a69-446f-a4e8-e6e2aaa73db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:10 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Volume volume-a94c8918-6afb-43e6-8d61-c0dcafa4d338 (a94c8918-6afb-43e6-8d61-c0dcafa4d338): created successfully Sep 28 17:08:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d5b12e-8a69-446f-a4e8-e6e2aaa73db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Flow 'volume_create_manager' (0044c343-bef6-4848-b250-73c37872bef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:10 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-b289f0d5-6797-4a2f-a426-8bc35144b32a tempest-AttachVolumeNegativeTest-1260692363 None] Created volume successfully. Sep 28 17:08:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-79c1a58a-25f0-4c50-8809-df875e765208 req-9ac4b34c-a2c1-4af8-bd86-1fc9b420f135 tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-79c1a58a-25f0-4c50-8809-df875e765208 req-9ac4b34c-a2c1-4af8-bd86-1fc9b420f135 tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-79c1a58a-25f0-4c50-8809-df875e765208 req-9ac4b34c-a2c1-4af8-bd86-1fc9b420f135 tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-79c1a58a-25f0-4c50-8809-df875e765208 req-9ac4b34c-a2c1-4af8-bd86-1fc9b420f135 tempest-AttachVolumeNegativeTest-1260692363 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-a94c8918-6afb-43e6-8d61-c0dcafa4d338', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '836cdfae-1bb2-4459-88d9-0de863927330', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:08:11 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-79c1a58a-25f0-4c50-8809-df875e765208 req-9ac4b34c-a2c1-4af8-bd86-1fc9b420f135 tempest-AttachVolumeNegativeTest-1260692363 None] attachment_update completed successfully. Sep 28 17:08:14 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-dcd0dba2-b33e-4930-8351-c0b41e42ac9d req-e580f454-4a58-4ba1-b738-8b97892b14e4 tempest-AttachVolumeNegativeTest-1260692363 None] Terminate volume connection completed successfully. Sep 28 17:08:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-dcd0dba2-b33e-4930-8351-c0b41e42ac9d req-e580f454-4a58-4ba1-b738-8b97892b14e4 tempest-AttachVolumeNegativeTest-1260692363 None] Deleting attachment 836cdfae-1bb2-4459-88d9-0de863927330. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Flow 'volume_create_manager' (3c6ca09b-97f7-4449-b0de-fb377eb8471d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb86a1b-9cd4-4fa4-b141-ac7a3f6a45ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb86a1b-9cd4-4fa4-b141-ac7a3f6a45ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1960126577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f12840d9eb4403bb7e3ad2e1ce2a58c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:21Z,use_quota=True,user_id='624180bb6a1b419da8069a89f9380f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d0007b-8e1d-4fac-8640-23a09b45fbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d0007b-8e1d-4fac-8640-23a09b45fbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48567a9-4246-4701-a60c-62d54a48037d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48567a9-4246-4701-a60c-62d54a48037d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e', 'volume_name': 'volume-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c5ee91-991b-4e4a-8846-374959d78ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c5ee91-991b-4e4a-8846-374959d78ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658f6f60-06aa-4cbd-8cb9-efaa56ff1497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:20 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Volume 0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e', 'volume_size': 1} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1960126577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f12840d9eb4403bb7e3ad2e1ce2a58c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:21Z,use_quota=True,user_id='624180bb6a1b419da8069a89f9380f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Creating volume 0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:20 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:08:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:21 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e 1073741824 Sep 28 17:08:21 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:21 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e 1073741824" returned: 0 in 0.850s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:21 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e Sep 28 17:08:21 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:22 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e" returned: 0 in 0.385s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658f6f60-06aa-4cbd-8cb9-efaa56ff1497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a3f8ab-a698-4819-86b1-1eee3f1c64d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:22 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Volume volume-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e (0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e): created successfully Sep 28 17:08:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a3f8ab-a698-4819-86b1-1eee3f1c64d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Flow 'volume_create_manager' (3c6ca09b-97f7-4449-b0de-fb377eb8471d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:22 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-60a3bbc2-1f6c-4d72-a95d-41eed19f79c3 tempest-AttachVolumeTestJSON-1953796176 None] Created volume successfully. Sep 28 17:08:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-69b16262-d0a1-40fc-bf1e-5aeed3180057 req-932f1e94-6107-4ea7-8fb3-41f31ffa01db tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-69b16262-d0a1-40fc-bf1e-5aeed3180057 req-932f1e94-6107-4ea7-8fb3-41f31ffa01db tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-69b16262-d0a1-40fc-bf1e-5aeed3180057 req-932f1e94-6107-4ea7-8fb3-41f31ffa01db tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-69b16262-d0a1-40fc-bf1e-5aeed3180057 req-932f1e94-6107-4ea7-8fb3-41f31ffa01db tempest-AttachVolumeTestJSON-1953796176 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad3826be-70f5-442a-978b-bd9ab3b787d0', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:08:24 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-69b16262-d0a1-40fc-bf1e-5aeed3180057 req-932f1e94-6107-4ea7-8fb3-41f31ffa01db tempest-AttachVolumeTestJSON-1953796176 None] attachment_update completed successfully. Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Flow 'volume_create_manager' (40a50477-6730-4897-8e47-b74d4fcbd39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3380add4-56a0-471c-9018-caccb2133c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3380add4-56a0-471c-9018-caccb2133c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1724809308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2223d44-93cd-4cf7-8b67-a4bc58c0c346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f12840d9eb4403bb7e3ad2e1ce2a58c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:27Z,use_quota=True,user_id='624180bb6a1b419da8069a89f9380f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8318ec-3899-431d-9cab-ddfca9ffca20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8318ec-3899-431d-9cab-ddfca9ffca20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c364b3-7f98-4695-9c96-10c39da47a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c364b3-7f98-4695-9c96-10c39da47a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2223d44-93cd-4cf7-8b67-a4bc58c0c346', 'volume_name': 'volume-a2223d44-93cd-4cf7-8b67-a4bc58c0c346', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef222f18-5719-4cef-9a8e-02e2e63bb7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef222f18-5719-4cef-9a8e-02e2e63bb7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3a8c3e-0a2f-44fc-b739-61ae00be77a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:27 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Volume a2223d44-93cd-4cf7-8b67-a4bc58c0c346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2223d44-93cd-4cf7-8b67-a4bc58c0c346', 'volume_size': 1} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1724809308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2223d44-93cd-4cf7-8b67-a4bc58c0c346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f12840d9eb4403bb7e3ad2e1ce2a58c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:27Z,use_quota=True,user_id='624180bb6a1b419da8069a89f9380f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Creating volume a2223d44-93cd-4cf7-8b67-a4bc58c0c346 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:27 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:08:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a2223d44-93cd-4cf7-8b67-a4bc58c0c346 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:27 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a2223d44-93cd-4cf7-8b67-a4bc58c0c346 1073741824 Sep 28 17:08:27 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:28 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Flow 'volume_create_manager' (06e0de87-b450-42db-86a8-3174ace3957b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d901711e-95b2-4e6f-a805-252b7ac0cc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d901711e-95b2-4e6f-a805-252b7ac0cc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1038599635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e393667-5a80-426c-b7ac-c723cc4147b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f8569314f45e98d5d7e4fac71cb02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:28Z,use_quota=True,user_id='43ac55cd854d482395da4370726b1ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aacd73f0-83ac-41eb-a335-7ec83dd4d563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aacd73f0-83ac-41eb-a335-7ec83dd4d563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9e8935-61e3-459e-9fa4-e9c343c260f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:28 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9e8935-61e3-459e-9fa4-e9c343c260f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e393667-5a80-426c-b7ac-c723cc4147b9', 'volume_name': 'volume-6e393667-5a80-426c-b7ac-c723cc4147b9', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38abbef4-67ff-4069-a286-e632a54e2a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38abbef4-67ff-4069-a286-e632a54e2a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fed1176-5799-4310-892b-ec308e1b3ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:28 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Volume 6e393667-5a80-426c-b7ac-c723cc4147b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e393667-5a80-426c-b7ac-c723cc4147b9', 'volume_size': 1} Sep 28 17:08:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a2223d44-93cd-4cf7-8b67-a4bc58c0c346 1073741824" returned: 0 in 0.923s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a2223d44-93cd-4cf7-8b67-a4bc58c0c346 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:28 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a2223d44-93cd-4cf7-8b67-a4bc58c0c346 Sep 28 17:08:28 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:29 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a2223d44-93cd-4cf7-8b67-a4bc58c0c346" returned: 0 in 0.520s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1038599635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e393667-5a80-426c-b7ac-c723cc4147b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f8569314f45e98d5d7e4fac71cb02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:28Z,use_quota=True,user_id='43ac55cd854d482395da4370726b1ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Creating volume 6e393667-5a80-426c-b7ac-c723cc4147b9 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:29 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:08:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6e393667-5a80-426c-b7ac-c723cc4147b9 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3a8c3e-0a2f-44fc-b739-61ae00be77a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2223d44-93cd-4cf7-8b67-a4bc58c0c346', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:29 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6e393667-5a80-426c-b7ac-c723cc4147b9 1073741824 Sep 28 17:08:29 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff62529-0540-4b5d-b9dc-3ababf9e9d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:29 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Volume volume-a2223d44-93cd-4cf7-8b67-a4bc58c0c346 (a2223d44-93cd-4cf7-8b67-a4bc58c0c346): created successfully Sep 28 17:08:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff62529-0540-4b5d-b9dc-3ababf9e9d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Flow 'volume_create_manager' (40a50477-6730-4897-8e47-b74d4fcbd39f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:29 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1f3a3311-b6db-49f4-8bfa-f75d720b7762 tempest-AttachVolumeTestJSON-1953796176 None] Created volume successfully. Sep 28 17:08:30 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6e393667-5a80-426c-b7ac-c723cc4147b9 1073741824" returned: 0 in 0.807s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6e393667-5a80-426c-b7ac-c723cc4147b9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:30 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6e393667-5a80-426c-b7ac-c723cc4147b9 Sep 28 17:08:30 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:30 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6e393667-5a80-426c-b7ac-c723cc4147b9" returned: 0 in 0.633s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fed1176-5799-4310-892b-ec308e1b3ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e393667-5a80-426c-b7ac-c723cc4147b9', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2287849-d1dd-48a7-a504-a6a9260aeca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:30 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Volume volume-6e393667-5a80-426c-b7ac-c723cc4147b9 (6e393667-5a80-426c-b7ac-c723cc4147b9): created successfully Sep 28 17:08:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2287849-d1dd-48a7-a504-a6a9260aeca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Flow 'volume_create_manager' (06e0de87-b450-42db-86a8-3174ace3957b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:30 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-59ae7a2b-74f0-403d-a753-ad2d05f2d1a5 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Created volume successfully. Sep 28 17:08:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-531d842a-d3c8-444b-a530-4c3b00e0c4ff req-a0e94440-da41-4847-9ad0-7775cd7ac165 tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-531d842a-d3c8-444b-a530-4c3b00e0c4ff req-a0e94440-da41-4847-9ad0-7775cd7ac165 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-531d842a-d3c8-444b-a530-4c3b00e0c4ff req-a0e94440-da41-4847-9ad0-7775cd7ac165 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-531d842a-d3c8-444b-a530-4c3b00e0c4ff req-a0e94440-da41-4847-9ad0-7775cd7ac165 tempest-AttachVolumeTestJSON-1953796176 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-a2223d44-93cd-4cf7-8b67-a4bc58c0c346', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1c2831e-bfae-479a-b095-25710744c572', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:08:31 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-531d842a-d3c8-444b-a530-4c3b00e0c4ff req-a0e94440-da41-4847-9ad0-7775cd7ac165 tempest-AttachVolumeTestJSON-1953796176 None] attachment_update completed successfully. Sep 28 17:08:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] Acquiring lock "cinder-6e393667-5a80-426c-b7ac-c723cc4147b9-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] Lock "cinder-6e393667-5a80-426c-b7ac-c723cc4147b9-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] Acquiring lock "cinder-quobyte-6e393667-5a80-426c-b7ac-c723cc4147b9" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] Lock "cinder-quobyte-6e393667-5a80-426c-b7ac-c723cc4147b9" acquired by "delete_volume" :: waited 0.043s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:32 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3773340f-63e0-4003-b26c-0a8aba80d2fc]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6e393667-5a80-426c-b7ac-c723cc4147b9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:32 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6e393667-5a80-426c-b7ac-c723cc4147b9 Sep 28 17:08:32 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:32 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6e393667-5a80-426c-b7ac-c723cc4147b9" returned: 0 in 0.783s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6e393667-5a80-426c-b7ac-c723cc4147b9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:32 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6e393667-5a80-426c-b7ac-c723cc4147b9 Sep 28 17:08:32 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:33 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6e393667-5a80-426c-b7ac-c723cc4147b9" returned: 0 in 0.442s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] Lock "cinder-quobyte-6e393667-5a80-426c-b7ac-c723cc4147b9" released by "delete_volume" :: held 1.314s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:33 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] Created reservations ['979429f5-34db-4b08-a643-dc1f920b54d4', '79f0381e-6152-4723-b42b-1a2026096fd2', 'b595bbc2-f7ba-442a-b1a3-8dab92fdf4c7', '723a38cd-9228-45c5-a93b-b54f87e5a895'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:33 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:08:33 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:34 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.699s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:34 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:34 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] Deleted volume successfully. Sep 28 17:08:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02446f18-5408-4577-9df9-8d51906867ff tempest-VolumeQuotasAdminTestJSON-1841453361 None] Lock "cinder-6e393667-5a80-426c-b7ac-c723cc4147b9-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Flow 'volume_create_manager' (6aa66485-2c16-4441-85d0-c7c47f2d4bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7115f0a7-d67b-4c99-ba94-495686c20612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7115f0a7-d67b-4c99-ba94-495686c20612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-27487656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f3dcb8-9a42-4eb9-96b9-72aeb725f183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f8569314f45e98d5d7e4fac71cb02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:35Z,use_quota=True,user_id='43ac55cd854d482395da4370726b1ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac690da0-337a-4032-88d3-224d6875f2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac690da0-337a-4032-88d3-224d6875f2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab82abf-0ae1-4178-a224-030ecb585a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab82abf-0ae1-4178-a224-030ecb585a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68f3dcb8-9a42-4eb9-96b9-72aeb725f183', 'volume_name': 'volume-68f3dcb8-9a42-4eb9-96b9-72aeb725f183', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85da7ea8-7087-4606-add9-2747d45a52cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85da7ea8-7087-4606-add9-2747d45a52cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed10684e-f294-453b-9056-4fc56607ad96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:35 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Volume 68f3dcb8-9a42-4eb9-96b9-72aeb725f183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68f3dcb8-9a42-4eb9-96b9-72aeb725f183', 'volume_size': 1} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-27487656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f3dcb8-9a42-4eb9-96b9-72aeb725f183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1f8569314f45e98d5d7e4fac71cb02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:35Z,use_quota=True,user_id='43ac55cd854d482395da4370726b1ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Creating volume 68f3dcb8-9a42-4eb9-96b9-72aeb725f183 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:35 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68f3dcb8-9a42-4eb9-96b9-72aeb725f183 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:35 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68f3dcb8-9a42-4eb9-96b9-72aeb725f183 1073741824 Sep 28 17:08:35 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:35 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-adca849d-d283-4b6a-b89b-5bfa1bf46739 req-b1b4e262-fdf4-4ac2-a888-23dbb4a9700a tempest-AttachVolumeTestJSON-1953796176 None] Terminate volume connection completed successfully. Sep 28 17:08:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-adca849d-d283-4b6a-b89b-5bfa1bf46739 req-b1b4e262-fdf4-4ac2-a888-23dbb4a9700a tempest-AttachVolumeTestJSON-1953796176 None] Deleting attachment ad3826be-70f5-442a-978b-bd9ab3b787d0. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:08:36 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68f3dcb8-9a42-4eb9-96b9-72aeb725f183 1073741824" returned: 0 in 0.790s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68f3dcb8-9a42-4eb9-96b9-72aeb725f183 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:36 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68f3dcb8-9a42-4eb9-96b9-72aeb725f183 Sep 28 17:08:36 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:37 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68f3dcb8-9a42-4eb9-96b9-72aeb725f183" returned: 0 in 0.456s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed10684e-f294-453b-9056-4fc56607ad96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f3dcb8-9a42-4eb9-96b9-72aeb725f183', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e9e905-c6be-48d3-9923-198a2e513ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:37 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Volume volume-68f3dcb8-9a42-4eb9-96b9-72aeb725f183 (68f3dcb8-9a42-4eb9-96b9-72aeb725f183): created successfully Sep 28 17:08:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e9e905-c6be-48d3-9923-198a2e513ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Flow 'volume_create_manager' (6aa66485-2c16-4441-85d0-c7c47f2d4bf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:37 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1ae311f2-908f-4072-9275-a48761868f33 tempest-VolumeQuotasAdminTestJSON-1841453361 None] Created volume successfully. Sep 28 17:08:38 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-66362c82-302b-4ed6-a779-a76f74fbacdd req-88a4fd0c-f373-4a72-9f60-45dfec1153b9 tempest-AttachVolumeTestJSON-1953796176 None] Terminate volume connection completed successfully. Sep 28 17:08:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-66362c82-302b-4ed6-a779-a76f74fbacdd req-88a4fd0c-f373-4a72-9f60-45dfec1153b9 tempest-AttachVolumeTestJSON-1953796176 None] Deleting attachment e1c2831e-bfae-479a-b095-25710744c572. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:08:39 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-6785bfe9-a816-4b17-a99d-d6048d1a9bbb tempest-VolumeQuotasAdminTestJSON-1406872646 None] Transfer volume completed successfully. Sep 28 17:08:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] Acquiring lock "cinder-68f3dcb8-9a42-4eb9-96b9-72aeb725f183-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] Lock "cinder-68f3dcb8-9a42-4eb9-96b9-72aeb725f183-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] Acquiring lock "cinder-quobyte-68f3dcb8-9a42-4eb9-96b9-72aeb725f183" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] Lock "cinder-quobyte-68f3dcb8-9a42-4eb9-96b9-72aeb725f183" acquired by "delete_volume" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:41 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[42520c0d-9840-4e60-b8b6-755ec797c047]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68f3dcb8-9a42-4eb9-96b9-72aeb725f183 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:42 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68f3dcb8-9a42-4eb9-96b9-72aeb725f183 Sep 28 17:08:42 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:42 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Flow 'volume_create_manager' (6d1807f3-d27d-44b0-81b8-5f9d128ca3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b8f129-4c10-4d5f-9959-67e3f50c8370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:42 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68f3dcb8-9a42-4eb9-96b9-72aeb725f183" returned: 0 in 1.148s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68f3dcb8-9a42-4eb9-96b9-72aeb725f183 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b8f129-4c10-4d5f-9959-67e3f50c8370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1191408708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01241afa114966845318035e8c3342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:42Z,use_quota=True,user_id='7b12a9b4ae15430db5b01f9d6a076217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:42 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68f3dcb8-9a42-4eb9-96b9-72aeb725f183 Sep 28 17:08:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d4b600-21fb-4008-a278-d56856c6080b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:42 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d4b600-21fb-4008-a278-d56856c6080b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70dec6f2-f1d2-4be1-9345-56826a41c7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70dec6f2-f1d2-4be1-9345-56826a41c7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4', 'volume_name': 'volume-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088a9d86-bc8a-4fe3-b282-4d8c048973e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088a9d86-bc8a-4fe3-b282-4d8c048973e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ef3fc5-40d3-4fb5-834e-a6f3ffd0f371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:43 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Volume 67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4', 'volume_size': 1} Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1191408708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01241afa114966845318035e8c3342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:42Z,use_quota=True,user_id='7b12a9b4ae15430db5b01f9d6a076217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Creating volume 67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:43 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:43 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4 1073741824 Sep 28 17:08:43 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:43 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68f3dcb8-9a42-4eb9-96b9-72aeb725f183" returned: 0 in 0.741s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] Lock "cinder-quobyte-68f3dcb8-9a42-4eb9-96b9-72aeb725f183" released by "delete_volume" :: held 2.037s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:43 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] Created reservations ['d842503f-a052-488f-94db-675647161cd2', 'b2432088-b9a1-4c19-b458-0e2f5a5fe74c', '667b6193-da9f-4e49-af58-d2ac374d656a', '5ca432b4-5cb7-4ee0-8395-6e2e6298be83'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:44 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:44 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:44 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:08:44 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:44 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4 1073741824" returned: 0 in 1.482s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:44 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4 Sep 28 17:08:44 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:45 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 1.198s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:45 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:45 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] Deleted volume successfully. Sep 28 17:08:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7942c8e1-857e-4d78-8105-5b2c0893097a tempest-VolumeQuotasAdminTestJSON-1476602869 None] Lock "cinder-68f3dcb8-9a42-4eb9-96b9-72aeb725f183-delete_volume" released by "delete_volume" :: held 3.873s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:45 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4" returned: 0 in 1.184s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:46 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] <== create_volume: return (2892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.899s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ef3fc5-40d3-4fb5-834e-a6f3ffd0f371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f40ccd-5bdf-4bfd-8635-59a5f0a67171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:46 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Volume volume-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4 (67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4): created successfully Sep 28 17:08:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f40ccd-5bdf-4bfd-8635-59a5f0a67171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Flow 'volume_create_manager' (6d1807f3-d27d-44b0-81b8-5f9d128ca3c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:46 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-c08ab358-e621-45cd-b331-825453931f31 tempest-VolumesActionsTest-689518095 None] Created volume successfully. Sep 28 17:08:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7579a9de-0174-4e37-ad3b-4ec93aebac3a tempest-VolumesActionsTest-689518095 None] Acquiring lock "cinder-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4" by "attach_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7579a9de-0174-4e37-ad3b-4ec93aebac3a tempest-VolumesActionsTest-689518095 None] Lock "cinder-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4" acquired by "attach_volume" :: waited 0.040s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:47 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-7579a9de-0174-4e37-ad3b-4ec93aebac3a tempest-VolumesActionsTest-689518095 None] Attaching volume 67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4 to instance 0620a40d-8a6a-486c-a237-8e0466e7efa8 at mountpoint /dev/vdb on host None. Sep 28 17:08:47 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-7579a9de-0174-4e37-ad3b-4ec93aebac3a tempest-VolumesActionsTest-689518095 None] Attach volume completed successfully. Sep 28 17:08:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7579a9de-0174-4e37-ad3b-4ec93aebac3a tempest-VolumesActionsTest-689518095 None] Lock "cinder-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4" released by "attach_volume" :: held 0.246s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:49 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-63c07208-0e22-497f-8d0f-5807ef555559 tempest-VolumesActionsTest-201877576 None] Terminate volume connection completed successfully. Sep 28 17:08:49 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-63c07208-0e22-497f-8d0f-5807ef555559 tempest-VolumesActionsTest-201877576 None] Acquiring lock "cinder-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4-detach_volume" by "detach_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:49 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-63c07208-0e22-497f-8d0f-5807ef555559 tempest-VolumesActionsTest-201877576 None] Lock "cinder-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4-detach_volume" acquired by "detach_volume" :: waited 0.145s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:49 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-63c07208-0e22-497f-8d0f-5807ef555559 tempest-VolumesActionsTest-201877576 None] Detaching volume 67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4 from instance 0620a40d-8a6a-486c-a237-8e0466e7efa8. Sep 28 17:08:49 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-63c07208-0e22-497f-8d0f-5807ef555559 tempest-VolumesActionsTest-201877576 None] Detach volume completed successfully. Sep 28 17:08:49 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-63c07208-0e22-497f-8d0f-5807ef555559 tempest-VolumesActionsTest-201877576 None] Lock "cinder-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4-detach_volume" released by "detach_volume" :: held 0.194s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c358797c-9c67-4559-8b09-617a48669cd4 tempest-VolumesActionsTest-689518095 None] Acquiring lock "cinder-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4-detach_volume" by "detach_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c358797c-9c67-4559-8b09-617a48669cd4 tempest-VolumesActionsTest-689518095 None] Lock "cinder-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4-detach_volume" acquired by "detach_volume" :: waited 0.072s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:50 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-c358797c-9c67-4559-8b09-617a48669cd4 tempest-VolumesActionsTest-689518095 None] Volume detach called, but volume not attached. Sep 28 17:08:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "cinder-a2223d44-93cd-4cf7-8b67-a4bc58c0c346-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c358797c-9c67-4559-8b09-617a48669cd4 tempest-VolumesActionsTest-689518095 None] Lock "cinder-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4-detach_volume" released by "detach_volume" :: held 0.079s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] Lock "cinder-a2223d44-93cd-4cf7-8b67-a4bc58c0c346-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "cinder-quobyte-a2223d44-93cd-4cf7-8b67-a4bc58c0c346" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] Lock "cinder-quobyte-a2223d44-93cd-4cf7-8b67-a4bc58c0c346" acquired by "delete_volume" :: waited 0.056s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:50 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b6e8b2-f527-4fe2-840c-89f42f0c2e30]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a2223d44-93cd-4cf7-8b67-a4bc58c0c346 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] Acquiring lock "cinder-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] Lock "cinder-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] Acquiring lock "cinder-quobyte-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] Lock "cinder-quobyte-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4" acquired by "delete_volume" :: waited 0.055s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:50 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a2223d44-93cd-4cf7-8b67-a4bc58c0c346 Sep 28 17:08:50 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:51 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[08eb9981-7082-4c9a-bfa5-20470be9f968]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:51 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a2223d44-93cd-4cf7-8b67-a4bc58c0c346" returned: 0 in 0.920s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a2223d44-93cd-4cf7-8b67-a4bc58c0c346 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:51 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4 Sep 28 17:08:51 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:51 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a2223d44-93cd-4cf7-8b67-a4bc58c0c346 Sep 28 17:08:51 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:52 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a2223d44-93cd-4cf7-8b67-a4bc58c0c346" returned: 0 in 0.594s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] Lock "cinder-quobyte-a2223d44-93cd-4cf7-8b67-a4bc58c0c346" released by "delete_volume" :: held 1.717s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:52 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] Created reservations ['30085840-383d-4159-a334-165efdb2465a', 'a986b712-7349-4be1-bec7-06ff0214e433', 'f2eb071d-620a-4a5a-ad3d-af29a94c1741', '6e0bd7f6-1688-497d-bb05-81cda3a111ff'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:52 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4" returned: 0 in 1.434s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:52 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4 Sep 28 17:08:52 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:52 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:08:52 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "cinder-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:53 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4" returned: 0 in 0.597s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] Lock "cinder-quobyte-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4" released by "delete_volume" :: held 2.232s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] Lock "cinder-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e-delete_volume" acquired by "delete_volume" :: waited 0.186s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "cinder-quobyte-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:53 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.851s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] Lock "cinder-quobyte-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e" acquired by "delete_volume" :: waited 0.089s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:53 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] Deleted volume successfully. Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9043e10-ebb3-4205-a598-275c691e03bb]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] Created reservations ['5014ff3f-9924-4450-bdfe-b69465118931', 'fb049602-096a-4f57-af81-5e24595afe98', '6304e8be-6adf-41aa-b011-b2d97a4bd178', '2a4a6fc8-69d0-4a2d-bde5-26be6b84ec65'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-756a8b99-aa4e-41aa-8628-1d50ab670eb8 tempest-AttachVolumeTestJSON-1953796176 None] Lock "cinder-a2223d44-93cd-4cf7-8b67-a4bc58c0c346-delete_volume" released by "delete_volume" :: held 3.400s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:53 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e Sep 28 17:08:53 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:53 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:08:53 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:54 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e" returned: 0 in 0.684s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:54 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e Sep 28 17:08:54 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:54 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.503s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:54 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:54 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] Deleted volume successfully. Sep 28 17:08:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9ddde9fa-51e7-4bbd-946e-1b205e4f0da9 tempest-VolumesActionsTest-689518095 None] Lock "cinder-67b8c9d3-062b-45ba-aee1-9d3f4b8d06a4-delete_volume" released by "delete_volume" :: held 3.695s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:54 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e" returned: 0 in 0.452s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] Lock "cinder-quobyte-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e" released by "delete_volume" :: held 1.235s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:54 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] Created reservations ['c6ce3b90-2f6c-42d2-943f-65e8278a95b2', '5e2b1f66-3f53-47d6-90ba-5c0247d34278', '31227216-f02c-455c-b4ed-bbb2e73c7f2f', '3a6b0784-8d63-4016-a318-73763700f0d8'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:55 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:08:55 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.503s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:55 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:55 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:55 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] Deleted volume successfully. Sep 28 17:08:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8ab10d28-d9c8-4565-a43b-e1744eb89075 tempest-AttachVolumeTestJSON-1953796176 None] Lock "cinder-0599aa06-2a7c-449d-9d14-e8f9a4d2dd2e-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "cinder-890336ef-5098-4030-98d1-021ede16b73f-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] Lock "cinder-890336ef-5098-4030-98d1-021ede16b73f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "cinder-quobyte-890336ef-5098-4030-98d1-021ede16b73f" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] Lock "cinder-quobyte-890336ef-5098-4030-98d1-021ede16b73f" acquired by "delete_volume" :: waited 0.017s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:56 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0759ef4-272e-4a6a-88b4-952802f989b5]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-890336ef-5098-4030-98d1-021ede16b73f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:56 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-890336ef-5098-4030-98d1-021ede16b73f Sep 28 17:08:56 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:56 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-890336ef-5098-4030-98d1-021ede16b73f" returned: 0 in 0.600s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-890336ef-5098-4030-98d1-021ede16b73f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:56 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-890336ef-5098-4030-98d1-021ede16b73f Sep 28 17:08:56 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:57 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-890336ef-5098-4030-98d1-021ede16b73f" returned: 0 in 0.507s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] Lock "cinder-quobyte-890336ef-5098-4030-98d1-021ede16b73f" released by "delete_volume" :: held 1.203s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:57 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:UPDATE=69,cinder:SELECT=72,cinder:DELETE=4,cinder:INSERT=13 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:08:57 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] Created reservations ['c4b75bad-dcbb-4417-b753-39fa81c37124', '2488bd0d-2a76-47e8-afb6-48cfb7f6a1ab', '359cad7a-52cd-4534-87b5-f851c72a21fd', '76113713-397e-41a9-80a2-790533bdec65'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:57 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:08:57 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:58 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.396s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:58 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:58 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] Deleted volume successfully. Sep 28 17:08:58 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=73,cinder:UPDATE=71,cinder:INSERT=18,cinder:DELETE=8 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:08:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3995c648-6b47-4997-a57d-dc4eee6b1166 tempest-AttachVolumeTestJSON-1953796176 None] Lock "cinder-890336ef-5098-4030-98d1-021ede16b73f-delete_volume" released by "delete_volume" :: held 2.075s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Flow 'volume_create_manager' (e3bfadae-40fc-47f9-a53d-a21caaf1d74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8171f7c6-edef-4f41-a7ed-0f70746e58ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8171f7c6-edef-4f41-a7ed-0f70746e58ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1621293228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=436e2aac-c879-4693-9c7e-3274257c6cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01241afa114966845318035e8c3342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:00Z,use_quota=True,user_id='7b12a9b4ae15430db5b01f9d6a076217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896c5f34-7cc6-4cd2-807d-7b27328f7cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896c5f34-7cc6-4cd2-807d-7b27328f7cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29162751-7b74-4156-baad-39dae90d1deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29162751-7b74-4156-baad-39dae90d1deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '436e2aac-c879-4693-9c7e-3274257c6cba', 'volume_name': 'volume-436e2aac-c879-4693-9c7e-3274257c6cba', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9977ae78-c203-412a-8322-0f47425a56ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9977ae78-c203-412a-8322-0f47425a56ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be386c17-2578-4054-940b-4f2ece52ff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:00 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Volume 436e2aac-c879-4693-9c7e-3274257c6cba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-436e2aac-c879-4693-9c7e-3274257c6cba', 'volume_size': 1} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1621293228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=436e2aac-c879-4693-9c7e-3274257c6cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01241afa114966845318035e8c3342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:00Z,use_quota=True,user_id='7b12a9b4ae15430db5b01f9d6a076217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Creating volume 436e2aac-c879-4693-9c7e-3274257c6cba {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:00 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-436e2aac-c879-4693-9c7e-3274257c6cba 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:00 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-436e2aac-c879-4693-9c7e-3274257c6cba 1073741824 Sep 28 17:09:00 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:00 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-436e2aac-c879-4693-9c7e-3274257c6cba 1073741824" returned: 0 in 0.790s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-436e2aac-c879-4693-9c7e-3274257c6cba {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:01 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-436e2aac-c879-4693-9c7e-3274257c6cba Sep 28 17:09:01 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:01 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:09:01 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:01 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-436e2aac-c879-4693-9c7e-3274257c6cba" returned: 0 in 0.596s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be386c17-2578-4054-940b-4f2ece52ff77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-436e2aac-c879-4693-9c7e-3274257c6cba', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:01 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db94c49-4950-41b2-9edd-873048557d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.586s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:09:01 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Volume volume-436e2aac-c879-4693-9c7e-3274257c6cba (436e2aac-c879-4693-9c7e-3274257c6cba): created successfully Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db94c49-4950-41b2-9edd-873048557d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Flow 'volume_create_manager' (e3bfadae-40fc-47f9-a53d-a21caaf1d74d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:01 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-900d7b1c-05c9-4abb-b422-7e365d3a745c tempest-VolumesActionsTest-689518095 None] Created volume successfully. Sep 28 17:09:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] Acquiring lock "cinder-436e2aac-c879-4693-9c7e-3274257c6cba-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] Lock "cinder-436e2aac-c879-4693-9c7e-3274257c6cba-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] Acquiring lock "cinder-quobyte-436e2aac-c879-4693-9c7e-3274257c6cba" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] Lock "cinder-quobyte-436e2aac-c879-4693-9c7e-3274257c6cba" acquired by "delete_volume" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:02 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[85618108-4a2c-4d8e-afc1-7d392bb43460]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-436e2aac-c879-4693-9c7e-3274257c6cba {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:02 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-436e2aac-c879-4693-9c7e-3274257c6cba Sep 28 17:09:02 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:02 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-436e2aac-c879-4693-9c7e-3274257c6cba" returned: 0 in 0.496s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-436e2aac-c879-4693-9c7e-3274257c6cba {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:02 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-436e2aac-c879-4693-9c7e-3274257c6cba Sep 28 17:09:02 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:03 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-436e2aac-c879-4693-9c7e-3274257c6cba" returned: 0 in 0.371s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] Lock "cinder-quobyte-436e2aac-c879-4693-9c7e-3274257c6cba" released by "delete_volume" :: held 0.926s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] Created reservations ['3a982179-bc6b-4891-aadb-4b6bc4d4145d', '0cb46dd7-e7a9-43b6-93e2-5ba44015b0c9', 'c5717d9a-f7b3-4678-8637-ca90a83252c8', '70915f49-f111-411c-b037-af35dfff8137'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:03 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:09:03 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:03 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.325s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:03 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] Deleted volume successfully. Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Flow 'volume_create_manager' (e77b52a3-7914-41f7-b995-4aa2a4cb871c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21325503-4738-4dbc-866a-3bf2944625af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2124ff32-3811-4e27-8d05-9c85618feaaf tempest-VolumesActionsTest-201877576 None] Lock "cinder-436e2aac-c879-4693-9c7e-3274257c6cba-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21325503-4738-4dbc-866a-3bf2944625af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1021473293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f4527d-0583-4c87-98c1-256278f92c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a94f412846c47ea8ba749249f18b1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:04Z,use_quota=True,user_id='8d59934a60194ff4b97e0f3e65c8df76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32c6813-3666-4d56-9215-831a8a6934b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32c6813-3666-4d56-9215-831a8a6934b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fac67d9-1355-4c0a-a929-7abb39eac11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fac67d9-1355-4c0a-a929-7abb39eac11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f4527d-0583-4c87-98c1-256278f92c5a', 'volume_name': 'volume-26f4527d-0583-4c87-98c1-256278f92c5a', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4663978-07de-43d7-bc42-cb77169647f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4663978-07de-43d7-bc42-cb77169647f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe31466b-7913-4f80-8236-7119d03dd10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:03 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Volume 26f4527d-0583-4c87-98c1-256278f92c5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f4527d-0583-4c87-98c1-256278f92c5a', 'volume_size': 1} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1021473293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f4527d-0583-4c87-98c1-256278f92c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a94f412846c47ea8ba749249f18b1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:04Z,use_quota=True,user_id='8d59934a60194ff4b97e0f3e65c8df76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Creating volume 26f4527d-0583-4c87-98c1-256278f92c5a {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:03 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:09:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-26f4527d-0583-4c87-98c1-256278f92c5a 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:04 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-26f4527d-0583-4c87-98c1-256278f92c5a 1073741824 Sep 28 17:09:04 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:04 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-26f4527d-0583-4c87-98c1-256278f92c5a 1073741824" returned: 0 in 0.489s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-26f4527d-0583-4c87-98c1-256278f92c5a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:04 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-26f4527d-0583-4c87-98c1-256278f92c5a Sep 28 17:09:04 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:04 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-26f4527d-0583-4c87-98c1-256278f92c5a" returned: 0 in 0.311s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe31466b-7913-4f80-8236-7119d03dd10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f4527d-0583-4c87-98c1-256278f92c5a', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd037b5-6941-474e-8c1d-827dc6d1a46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:04 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Volume volume-26f4527d-0583-4c87-98c1-256278f92c5a (26f4527d-0583-4c87-98c1-256278f92c5a): created successfully Sep 28 17:09:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd037b5-6941-474e-8c1d-827dc6d1a46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Flow 'volume_create_manager' (e77b52a3-7914-41f7-b995-4aa2a4cb871c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:04 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2202880c-6283-4fa6-9b37-24f92234eafc tempest-VolumesServicesTestJSON-157005 None] Created volume successfully. Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Flow 'volume_create_manager' (cb2a711b-f848-47d5-910c-67abdf1a0c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a5acbd-8276-4aaa-8868-950a1cd42ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a5acbd-8276-4aaa-8868-950a1cd42ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1848700824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c37baae-a684-4170-9ee2-e8ed0c6ea948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01241afa114966845318035e8c3342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:05Z,use_quota=True,user_id='7b12a9b4ae15430db5b01f9d6a076217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0627e62-f701-4dce-b05b-47f19efe2136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0627e62-f701-4dce-b05b-47f19efe2136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe52167-ef40-4375-b744-6af0565e8486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe52167-ef40-4375-b744-6af0565e8486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c37baae-a684-4170-9ee2-e8ed0c6ea948', 'volume_name': 'volume-4c37baae-a684-4170-9ee2-e8ed0c6ea948', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0059fb-fc3a-4444-88d4-348d448bc169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0059fb-fc3a-4444-88d4-348d448bc169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567ba938-d86f-4521-98e2-4fb3ab0631eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:05 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Volume 4c37baae-a684-4170-9ee2-e8ed0c6ea948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c37baae-a684-4170-9ee2-e8ed0c6ea948', 'volume_size': 1} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1848700824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c37baae-a684-4170-9ee2-e8ed0c6ea948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01241afa114966845318035e8c3342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:05Z,use_quota=True,user_id='7b12a9b4ae15430db5b01f9d6a076217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Creating volume 4c37baae-a684-4170-9ee2-e8ed0c6ea948 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:05 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4c37baae-a684-4170-9ee2-e8ed0c6ea948 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:05 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4c37baae-a684-4170-9ee2-e8ed0c6ea948 1073741824 Sep 28 17:09:05 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:05 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4c37baae-a684-4170-9ee2-e8ed0c6ea948 1073741824" returned: 0 in 0.501s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4c37baae-a684-4170-9ee2-e8ed0c6ea948 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:06 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4c37baae-a684-4170-9ee2-e8ed0c6ea948 Sep 28 17:09:06 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] Acquiring lock "cinder-26f4527d-0583-4c87-98c1-256278f92c5a-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] Lock "cinder-26f4527d-0583-4c87-98c1-256278f92c5a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] Acquiring lock "cinder-quobyte-26f4527d-0583-4c87-98c1-256278f92c5a" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:06 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4c37baae-a684-4170-9ee2-e8ed0c6ea948" returned: 0 in 0.344s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] Lock "cinder-quobyte-26f4527d-0583-4c87-98c1-256278f92c5a" acquired by "delete_volume" :: waited 0.026s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567ba938-d86f-4521-98e2-4fb3ab0631eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c37baae-a684-4170-9ee2-e8ed0c6ea948', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a379ac0-cbdb-43e2-ba00-95ca4f6e41e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:06 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b83c43-1ce3-4095-b676-df549631620f]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-26f4527d-0583-4c87-98c1-256278f92c5a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:06 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Volume volume-4c37baae-a684-4170-9ee2-e8ed0c6ea948 (4c37baae-a684-4170-9ee2-e8ed0c6ea948): created successfully Sep 28 17:09:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a379ac0-cbdb-43e2-ba00-95ca4f6e41e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Flow 'volume_create_manager' (cb2a711b-f848-47d5-910c-67abdf1a0c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:06 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-24df11f8-6cbf-436e-ae90-3aa2b2b352ec tempest-VolumesActionsTest-689518095 None] Created volume successfully. Sep 28 17:09:06 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-26f4527d-0583-4c87-98c1-256278f92c5a Sep 28 17:09:06 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:06 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-26f4527d-0583-4c87-98c1-256278f92c5a" returned: 0 in 0.425s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-26f4527d-0583-4c87-98c1-256278f92c5a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:06 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-26f4527d-0583-4c87-98c1-256278f92c5a Sep 28 17:09:06 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:07 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-26f4527d-0583-4c87-98c1-256278f92c5a" returned: 0 in 0.291s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] Lock "cinder-quobyte-26f4527d-0583-4c87-98c1-256278f92c5a" released by "delete_volume" :: held 0.780s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] Created reservations ['7c537c28-ebad-43f4-878e-328e3c2bb849', '0dd49d4b-a82c-4ea3-ac2f-8d34e1a2a7fb', '8a9fa52d-149e-4df1-9984-2a1b1c4cee89', '82d3f595-da54-4bf8-9b3d-b380a3734d61'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:07 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:09:07 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] Acquiring lock "cinder-4c37baae-a684-4170-9ee2-e8ed0c6ea948-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:07 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.403s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:07 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] Deleted volume successfully. Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] Lock "cinder-4c37baae-a684-4170-9ee2-e8ed0c6ea948-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6f9d59fc-ebb2-4bee-a46f-bc9f0dfc0918 tempest-VolumesServicesTestJSON-157005 None] Lock "cinder-26f4527d-0583-4c87-98c1-256278f92c5a-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] Acquiring lock "cinder-quobyte-4c37baae-a684-4170-9ee2-e8ed0c6ea948" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] Lock "cinder-quobyte-4c37baae-a684-4170-9ee2-e8ed0c6ea948" acquired by "delete_volume" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf8f2eb-3e9c-4327-a410-dd4d3170bfa2]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4c37baae-a684-4170-9ee2-e8ed0c6ea948 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:07 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4c37baae-a684-4170-9ee2-e8ed0c6ea948 Sep 28 17:09:07 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:08 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4c37baae-a684-4170-9ee2-e8ed0c6ea948" returned: 0 in 0.545s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4c37baae-a684-4170-9ee2-e8ed0c6ea948 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:08 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4c37baae-a684-4170-9ee2-e8ed0c6ea948 Sep 28 17:09:08 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:08 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4c37baae-a684-4170-9ee2-e8ed0c6ea948" returned: 0 in 0.521s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] Lock "cinder-quobyte-4c37baae-a684-4170-9ee2-e8ed0c6ea948" released by "delete_volume" :: held 1.131s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:09 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] Created reservations ['5d638b96-87ff-4d1b-8c89-232e8fc98a69', 'fbc8bd38-ebb2-4e54-9245-bc4230cc1084', '08ac0381-5354-4da0-b1d1-c9b3e67e38e1', 'ac8c30ef-020c-4454-b6bb-c592ea063e0f'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:09 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:09:09 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:09 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.529s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:09 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:09 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] Deleted volume successfully. Sep 28 17:09:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-91d6dd47-b077-409e-91c7-1310c2712115 tempest-VolumesActionsTest-201877576 None] Lock "cinder-4c37baae-a684-4170-9ee2-e8ed0c6ea948-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Flow 'volume_create_manager' (5e6b7651-1f58-4a09-a8ba-2e6a80d3fac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09e2165-22bc-442e-8169-0a10759e3f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09e2165-22bc-442e-8169-0a10759e3f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1001920949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34cecae0-912c-4798-9efc-9022da7b4b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01241afa114966845318035e8c3342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:11Z,use_quota=True,user_id='7b12a9b4ae15430db5b01f9d6a076217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f8e201-c7ec-4a6f-a4ee-bd112069920a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f8e201-c7ec-4a6f-a4ee-bd112069920a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0e176c-5489-4d44-b54f-9edd31381f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0e176c-5489-4d44-b54f-9edd31381f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34cecae0-912c-4798-9efc-9022da7b4b63', 'volume_name': 'volume-34cecae0-912c-4798-9efc-9022da7b4b63', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf912d2-19ac-4ffe-8f98-9199f34b791d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf912d2-19ac-4ffe-8f98-9199f34b791d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34cd6f61-a09f-4b7e-9507-acf5a0f94ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:10 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Volume 34cecae0-912c-4798-9efc-9022da7b4b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34cecae0-912c-4798-9efc-9022da7b4b63', 'volume_size': 1} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1001920949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34cecae0-912c-4798-9efc-9022da7b4b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01241afa114966845318035e8c3342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:11Z,use_quota=True,user_id='7b12a9b4ae15430db5b01f9d6a076217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Creating volume 34cecae0-912c-4798-9efc-9022da7b4b63 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:11 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:09:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34cecae0-912c-4798-9efc-9022da7b4b63 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:11 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34cecae0-912c-4798-9efc-9022da7b4b63 1073741824 Sep 28 17:09:11 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:11 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34cecae0-912c-4798-9efc-9022da7b4b63 1073741824" returned: 0 in 0.673s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34cecae0-912c-4798-9efc-9022da7b4b63 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:11 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34cecae0-912c-4798-9efc-9022da7b4b63 Sep 28 17:09:11 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:12 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34cecae0-912c-4798-9efc-9022da7b4b63" returned: 0 in 0.390s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34cd6f61-a09f-4b7e-9507-acf5a0f94ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34cecae0-912c-4798-9efc-9022da7b4b63', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8833cc20-2dde-48a9-87f1-c04502de4b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:12 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Volume volume-34cecae0-912c-4798-9efc-9022da7b4b63 (34cecae0-912c-4798-9efc-9022da7b4b63): created successfully Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8833cc20-2dde-48a9-87f1-c04502de4b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Flow 'volume_create_manager' (5e6b7651-1f58-4a09-a8ba-2e6a80d3fac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:12 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-eb228bf9-f2db-4838-a412-1fad7cabea02 tempest-VolumesActionsTest-689518095 None] Created volume successfully. Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Flow 'volume_create_manager' (e6ccc3f3-0a1d-491a-b2e3-db5f4a7e73b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d52b801-f952-48fa-b0d5-4577bcb9c0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d52b801-f952-48fa-b0d5-4577bcb9c0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2126430296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f482ac8d-61f9-468f-9031-e9d1fb982ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd3e6d242a741cd99c53f208ee30c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:12Z,use_quota=True,user_id='108688bc6d4e4890a293d681cc913b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5af7378-c27f-4108-bb45-511d2049f07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5af7378-c27f-4108-bb45-511d2049f07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5e623b-0f59-4d39-a457-e90b87a95435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5e623b-0f59-4d39-a457-e90b87a95435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f482ac8d-61f9-468f-9031-e9d1fb982ebc', 'volume_name': 'volume-f482ac8d-61f9-468f-9031-e9d1fb982ebc', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b651b0-8c9e-4938-92fd-eaa9528e5a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b651b0-8c9e-4938-92fd-eaa9528e5a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1918a4f6-56a6-4a37-b602-bc4eb3704d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:12 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Volume f482ac8d-61f9-468f-9031-e9d1fb982ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f482ac8d-61f9-468f-9031-e9d1fb982ebc', 'volume_size': 1} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2126430296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f482ac8d-61f9-468f-9031-e9d1fb982ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd3e6d242a741cd99c53f208ee30c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:12Z,use_quota=True,user_id='108688bc6d4e4890a293d681cc913b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Creating volume f482ac8d-61f9-468f-9031-e9d1fb982ebc {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:12 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:09:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f482ac8d-61f9-468f-9031-e9d1fb982ebc 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:12 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f482ac8d-61f9-468f-9031-e9d1fb982ebc 1073741824 Sep 28 17:09:12 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:13 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f482ac8d-61f9-468f-9031-e9d1fb982ebc 1073741824" returned: 0 in 0.681s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] Acquiring lock "cinder-34cecae0-912c-4798-9efc-9022da7b4b63-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] Lock "cinder-34cecae0-912c-4798-9efc-9022da7b4b63-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f482ac8d-61f9-468f-9031-e9d1fb982ebc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] Acquiring lock "cinder-quobyte-34cecae0-912c-4798-9efc-9022da7b4b63" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:13 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f482ac8d-61f9-468f-9031-e9d1fb982ebc Sep 28 17:09:13 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] Lock "cinder-quobyte-34cecae0-912c-4798-9efc-9022da7b4b63" acquired by "delete_volume" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:13 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[89378b0f-09d0-4d7e-83d1-994f4fa35d03]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34cecae0-912c-4798-9efc-9022da7b4b63 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:13 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34cecae0-912c-4798-9efc-9022da7b4b63 Sep 28 17:09:13 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:13 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f482ac8d-61f9-468f-9031-e9d1fb982ebc" returned: 0 in 0.367s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:13 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1918a4f6-56a6-4a37-b602-bc4eb3704d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f482ac8d-61f9-468f-9031-e9d1fb982ebc', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0198b3e4-6ac6-4f76-8f5e-8013fcb244e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:13 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Volume volume-f482ac8d-61f9-468f-9031-e9d1fb982ebc (f482ac8d-61f9-468f-9031-e9d1fb982ebc): created successfully Sep 28 17:09:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0198b3e4-6ac6-4f76-8f5e-8013fcb244e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Flow 'volume_create_manager' (e6ccc3f3-0a1d-491a-b2e3-db5f4a7e73b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:13 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-188768d4-57bd-4c84-afa9-b49c64aa7fec tempest-AttachVolumeNegativeTest-1260692363 None] Created volume successfully. Sep 28 17:09:14 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34cecae0-912c-4798-9efc-9022da7b4b63" returned: 0 in 0.533s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34cecae0-912c-4798-9efc-9022da7b4b63 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:14 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34cecae0-912c-4798-9efc-9022da7b4b63 Sep 28 17:09:14 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:14 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34cecae0-912c-4798-9efc-9022da7b4b63" returned: 0 in 0.371s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] Lock "cinder-quobyte-34cecae0-912c-4798-9efc-9022da7b4b63" released by "delete_volume" :: held 0.965s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:14 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] Created reservations ['8a417279-e326-4fd4-b172-f14622befd6e', '076e4e31-37dd-4c3f-98c8-f29e8a26ed87', 'aa574ab4-0591-4a08-9b53-a49677072784', '9a32a838-06d2-408e-95e0-79a821ede066'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:14 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:14 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:14 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:09:14 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:15 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.443s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:15 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:15 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] Deleted volume successfully. Sep 28 17:09:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fbb7b06c-1f16-4646-b41b-768f386095b1 tempest-VolumesActionsTest-201877576 None] Lock "cinder-34cecae0-912c-4798-9efc-9022da7b4b63-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-aba0977c-b213-4abd-bf39-65716b20f246 req-76f75ad2-c437-40c9-9060-4330f6984bc8 tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-aba0977c-b213-4abd-bf39-65716b20f246 req-76f75ad2-c437-40c9-9060-4330f6984bc8 tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-aba0977c-b213-4abd-bf39-65716b20f246 req-76f75ad2-c437-40c9-9060-4330f6984bc8 tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-aba0977c-b213-4abd-bf39-65716b20f246 req-76f75ad2-c437-40c9-9060-4330f6984bc8 tempest-AttachVolumeNegativeTest-1260692363 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-f482ac8d-61f9-468f-9031-e9d1fb982ebc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'defaed0d-a7a1-45a0-b598-50f184ba4705', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:09:15 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-aba0977c-b213-4abd-bf39-65716b20f246 req-76f75ad2-c437-40c9-9060-4330f6984bc8 tempest-AttachVolumeNegativeTest-1260692363 None] attachment_update completed successfully. Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Flow 'volume_create_manager' (0f653204-b39a-47f8-a33b-5aed1aba9669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda63c69-4631-4fc2-92f7-7170c3b44e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda63c69-4631-4fc2-92f7-7170c3b44e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1335633889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b1b4aba-926a-4117-8e72-2340292f7266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01241afa114966845318035e8c3342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:17Z,use_quota=True,user_id='7b12a9b4ae15430db5b01f9d6a076217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073f2cdb-93a2-49e8-be4f-c243b93b4cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073f2cdb-93a2-49e8-be4f-c243b93b4cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99216205-985d-47a1-be41-0a816a0380e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99216205-985d-47a1-be41-0a816a0380e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b1b4aba-926a-4117-8e72-2340292f7266', 'volume_name': 'volume-9b1b4aba-926a-4117-8e72-2340292f7266', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b952f6ff-c683-413e-bfa8-0d3f5be64b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b952f6ff-c683-413e-bfa8-0d3f5be64b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a396714f-b3d9-43db-b866-269ea3c183ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:16 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Volume 9b1b4aba-926a-4117-8e72-2340292f7266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b1b4aba-926a-4117-8e72-2340292f7266', 'volume_size': 1} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1335633889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b1b4aba-926a-4117-8e72-2340292f7266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01241afa114966845318035e8c3342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:17Z,use_quota=True,user_id='7b12a9b4ae15430db5b01f9d6a076217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Creating volume 9b1b4aba-926a-4117-8e72-2340292f7266 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:16 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:09:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b1b4aba-926a-4117-8e72-2340292f7266 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:16 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b1b4aba-926a-4117-8e72-2340292f7266 1073741824 Sep 28 17:09:16 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:17 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b1b4aba-926a-4117-8e72-2340292f7266 1073741824" returned: 0 in 0.718s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b1b4aba-926a-4117-8e72-2340292f7266 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:17 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b1b4aba-926a-4117-8e72-2340292f7266 Sep 28 17:09:17 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:17 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b1b4aba-926a-4117-8e72-2340292f7266" returned: 0 in 0.400s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a396714f-b3d9-43db-b866-269ea3c183ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b1b4aba-926a-4117-8e72-2340292f7266', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e12248-2c55-45c1-9a97-c9245c6f1b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:18 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Volume volume-9b1b4aba-926a-4117-8e72-2340292f7266 (9b1b4aba-926a-4117-8e72-2340292f7266): created successfully Sep 28 17:09:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e12248-2c55-45c1-9a97-c9245c6f1b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Flow 'volume_create_manager' (0f653204-b39a-47f8-a33b-5aed1aba9669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:18 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-7ccb060a-27ed-4e78-95c5-690b31a91cb4 tempest-VolumesActionsTest-689518095 None] Created volume successfully. Sep 28 17:09:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] Acquiring lock "cinder-9b1b4aba-926a-4117-8e72-2340292f7266-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] Lock "cinder-9b1b4aba-926a-4117-8e72-2340292f7266-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:19 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-d7d7ef23-a048-4214-b4fa-571d137c19dc req-56028ecb-2329-4b31-be30-e072c48c53e7 tempest-AttachVolumeNegativeTest-1260692363 None] Terminate volume connection completed successfully. Sep 28 17:09:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-d7d7ef23-a048-4214-b4fa-571d137c19dc req-56028ecb-2329-4b31-be30-e072c48c53e7 tempest-AttachVolumeNegativeTest-1260692363 None] Deleting attachment defaed0d-a7a1-45a0-b598-50f184ba4705. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:09:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] Acquiring lock "cinder-quobyte-9b1b4aba-926a-4117-8e72-2340292f7266" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] Lock "cinder-quobyte-9b1b4aba-926a-4117-8e72-2340292f7266" acquired by "delete_volume" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:19 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[db639d4d-e440-471e-aff9-7ddd280eb21f]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b1b4aba-926a-4117-8e72-2340292f7266 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:19 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b1b4aba-926a-4117-8e72-2340292f7266 Sep 28 17:09:19 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:19 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b1b4aba-926a-4117-8e72-2340292f7266" returned: 0 in 0.584s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b1b4aba-926a-4117-8e72-2340292f7266 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:19 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b1b4aba-926a-4117-8e72-2340292f7266 Sep 28 17:09:19 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:20 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b1b4aba-926a-4117-8e72-2340292f7266" returned: 0 in 0.410s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] Lock "cinder-quobyte-9b1b4aba-926a-4117-8e72-2340292f7266" released by "delete_volume" :: held 1.095s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:20 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] Created reservations ['c746c5c7-2421-4b15-94f4-4d9544462f5f', '7f8d1e82-8b9b-4add-8d34-8c957ba1a267', '593544ea-6781-437e-96d3-435bceb0ae2b', '4c23dd28-96fe-407b-8145-11ca4ba80db8'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:20 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:09:20 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:21 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.574s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:21 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:21 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] Deleted volume successfully. Sep 28 17:09:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3004662e-f055-40fb-9d38-c184374800ae tempest-VolumesActionsTest-201877576 None] Lock "cinder-9b1b4aba-926a-4117-8e72-2340292f7266-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Flow 'volume_create_manager' (9bea2cda-6ece-4ce1-accc-6aa494f586b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318f3b2a-d997-47fd-b1fb-b660787a0682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318f3b2a-d997-47fd-b1fb-b660787a0682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2039705017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b3bdde-f5c0-43a8-8875-d805ae86f109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01241afa114966845318035e8c3342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:22Z,use_quota=True,user_id='7b12a9b4ae15430db5b01f9d6a076217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea26844-b54c-4269-abf8-c7860e443844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea26844-b54c-4269-abf8-c7860e443844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44585ad-9df7-49cb-8745-7e83b0aaa3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44585ad-9df7-49cb-8745-7e83b0aaa3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55b3bdde-f5c0-43a8-8875-d805ae86f109', 'volume_name': 'volume-55b3bdde-f5c0-43a8-8875-d805ae86f109', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1884f7-180d-416c-803d-1a8cfe6aab0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1884f7-180d-416c-803d-1a8cfe6aab0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec0e1d8-e1cc-4070-9245-74f627f09a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:22 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Volume 55b3bdde-f5c0-43a8-8875-d805ae86f109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55b3bdde-f5c0-43a8-8875-d805ae86f109', 'volume_size': 1} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2039705017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b3bdde-f5c0-43a8-8875-d805ae86f109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01241afa114966845318035e8c3342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:22Z,use_quota=True,user_id='7b12a9b4ae15430db5b01f9d6a076217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Creating volume 55b3bdde-f5c0-43a8-8875-d805ae86f109 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:22 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:09:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-55b3bdde-f5c0-43a8-8875-d805ae86f109 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:22 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-55b3bdde-f5c0-43a8-8875-d805ae86f109 1073741824 Sep 28 17:09:22 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:23 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-55b3bdde-f5c0-43a8-8875-d805ae86f109 1073741824" returned: 0 in 0.689s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-55b3bdde-f5c0-43a8-8875-d805ae86f109 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:23 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-55b3bdde-f5c0-43a8-8875-d805ae86f109 Sep 28 17:09:23 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:23 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-55b3bdde-f5c0-43a8-8875-d805ae86f109" returned: 0 in 0.474s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:23 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec0e1d8-e1cc-4070-9245-74f627f09a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55b3bdde-f5c0-43a8-8875-d805ae86f109', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed30fd10-b9d1-4bef-bd79-c8ae186b7a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:23 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Volume volume-55b3bdde-f5c0-43a8-8875-d805ae86f109 (55b3bdde-f5c0-43a8-8875-d805ae86f109): created successfully Sep 28 17:09:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed30fd10-b9d1-4bef-bd79-c8ae186b7a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Flow 'volume_create_manager' (9bea2cda-6ece-4ce1-accc-6aa494f586b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:23 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a063d88a-0b05-4887-a9c9-98a7e0d7fc55 tempest-VolumesActionsTest-689518095 None] Created volume successfully. Sep 28 17:09:25 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] Acquiring lock "cinder-55b3bdde-f5c0-43a8-8875-d805ae86f109-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:25 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] Lock "cinder-55b3bdde-f5c0-43a8-8875-d805ae86f109-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:25 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] Acquiring lock "cinder-quobyte-55b3bdde-f5c0-43a8-8875-d805ae86f109" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:25 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] Lock "cinder-quobyte-55b3bdde-f5c0-43a8-8875-d805ae86f109" acquired by "delete_volume" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:25 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c4cf6b-30ca-4376-b64d-c60ac974b85e]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-55b3bdde-f5c0-43a8-8875-d805ae86f109 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:25 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-55b3bdde-f5c0-43a8-8875-d805ae86f109 Sep 28 17:09:25 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:26 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-55b3bdde-f5c0-43a8-8875-d805ae86f109" returned: 0 in 0.667s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-55b3bdde-f5c0-43a8-8875-d805ae86f109 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:26 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-55b3bdde-f5c0-43a8-8875-d805ae86f109 Sep 28 17:09:26 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:26 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-55b3bdde-f5c0-43a8-8875-d805ae86f109" returned: 0 in 0.377s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] Lock "cinder-quobyte-55b3bdde-f5c0-43a8-8875-d805ae86f109" released by "delete_volume" :: held 1.119s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "cinder-f482ac8d-61f9-468f-9031-e9d1fb982ebc-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] Lock "cinder-f482ac8d-61f9-468f-9031-e9d1fb982ebc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "cinder-quobyte-f482ac8d-61f9-468f-9031-e9d1fb982ebc" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] Lock "cinder-quobyte-f482ac8d-61f9-468f-9031-e9d1fb982ebc" acquired by "delete_volume" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:26 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] Created reservations ['baefcf36-c9a1-4c7b-bd5a-cbee530e12ea', '265435ed-5bc4-44ca-b90f-a82fe0939ed1', '4014ec88-bf4e-457d-8c1a-a2756a22a7ce', '7e44e729-8f1b-4599-8336-4d97c32428a7'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:26 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a1658f-c7bf-46fb-a5ea-13d04608a7bf]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f482ac8d-61f9-468f-9031-e9d1fb982ebc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:27 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f482ac8d-61f9-468f-9031-e9d1fb982ebc Sep 28 17:09:27 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:27 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:09:27 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:27 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.477s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:27 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:27 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f482ac8d-61f9-468f-9031-e9d1fb982ebc" returned: 0 in 0.693s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f482ac8d-61f9-468f-9031-e9d1fb982ebc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:27 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] Deleted volume successfully. Sep 28 17:09:27 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f482ac8d-61f9-468f-9031-e9d1fb982ebc Sep 28 17:09:27 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ed267d5f-58b6-498f-98bd-c0f6d0b90cd9 tempest-VolumesActionsTest-689518095 None] Lock "cinder-55b3bdde-f5c0-43a8-8875-d805ae86f109-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:27 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f482ac8d-61f9-468f-9031-e9d1fb982ebc" returned: 0 in 0.421s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] Lock "cinder-quobyte-f482ac8d-61f9-468f-9031-e9d1fb982ebc" released by "delete_volume" :: held 1.190s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:28 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] Created reservations ['0c999565-5b8e-493e-b41a-2f07404ee824', '9293924c-4688-4c57-b787-95fbbb5f71cb', '83ec2363-5dc4-41d8-9c61-2c79d08ca33d', '8f189b6f-9138-4c95-b0c4-54b53eb1724e'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:28 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:09:28 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:28 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.322s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:28 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:28 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] Deleted volume successfully. Sep 28 17:09:28 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d7442c5a-c8d7-4d1d-85a2-ba11f6b9b7fa tempest-AttachVolumeNegativeTest-1260692363 None] Lock "cinder-f482ac8d-61f9-468f-9031-e9d1fb982ebc-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "cinder-a94c8918-6afb-43e6-8d61-c0dcafa4d338-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] Lock "cinder-a94c8918-6afb-43e6-8d61-c0dcafa4d338-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "cinder-quobyte-a94c8918-6afb-43e6-8d61-c0dcafa4d338" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:29 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Flow 'volume_create_manager' (e756132c-8d4b-4e35-b654-dfb608c4711f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ff033c-c07c-4802-8260-9b5314cffa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] Lock "cinder-quobyte-a94c8918-6afb-43e6-8d61-c0dcafa4d338" acquired by "delete_volume" :: waited 0.049s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ff033c-c07c-4802-8260-9b5314cffa73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1838722466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3063ff00-3c62-485e-87c7-a8df475c2937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb823ea468ec40788c244ae5c7e5bbe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:29Z,use_quota=True,user_id='724cb1ff2287487486718d015c6edd4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54a5ecf-6867-4665-a339-0ec0cde90909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54a5ecf-6867-4665-a339-0ec0cde90909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8808ff59-75ef-4074-ae5c-b129123d936c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:29 devstack cinder-volume[86970]: DEBUG cinder.image.glance [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Creating Keystone auth plugin from conf {{(pid=86970) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:09:29 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e73232-e44f-4583-9cf2-b3dfdef30243]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a94c8918-6afb-43e6-8d61-c0dcafa4d338 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:29 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a94c8918-6afb-43e6-8d61-c0dcafa4d338 Sep 28 17:09:29 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:30 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a94c8918-6afb-43e6-8d61-c0dcafa4d338" returned: 0 in 0.591s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a94c8918-6afb-43e6-8d61-c0dcafa4d338 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:30 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a94c8918-6afb-43e6-8d61-c0dcafa4d338 Sep 28 17:09:30 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8808ff59-75ef-4074-ae5c-b129123d936c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3063ff00-3c62-485e-87c7-a8df475c2937', 'volume_name': 'volume-3063ff00-3c62-485e-87c7-a8df475c2937', 'volume_size': 1, 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '280d624e0a3d44539d88968c5a0e8318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248419cd-b6f4-4e56-aeac-5930398932ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248419cd-b6f4-4e56-aeac-5930398932ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca54fd9c-356d-4a87-a647-f42a12bf4a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:30 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Volume 3063ff00-3c62-485e-87c7-a8df475c2937: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3063ff00-3c62-485e-87c7-a8df475c2937', 'volume_size': 1, 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '280d624e0a3d44539d88968c5a0e8318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Trying to clone 3063ff00-3c62-485e-87c7-a8df475c2937 from image d659fbbf-f540-415a-bb1b-8ef207a29f4e at location (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]). {{(pid=86970) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:09:30 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a94c8918-6afb-43e6-8d61-c0dcafa4d338" returned: 0 in 0.412s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] Lock "cinder-quobyte-a94c8918-6afb-43e6-8d61-c0dcafa4d338" released by "delete_volume" :: held 1.081s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] Created reservations ['67226691-ec3b-474f-93ad-6fc1ab56f1b1', '3f0b681e-4b33-48b2-acd1-c1016ea4e405', '6f26a2a8-b846-440e-86a7-6814b524abbc', '898b6dd7-b7ea-4ab0-9a52-e944392f686e'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_5e9lbt4fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:09:30 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:30 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:09:30 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[8645f06c-ea0f-4a1b-bb11-e51897e37117]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_5e9lbt4fdevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:31 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_5e9lbt4fdevstack@QuobyteHD Sep 28 17:09:31 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:31 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.358s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:31 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:31 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] Deleted volume successfully. Sep 28 17:09:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bc35ad04-2b33-485c-9d08-7e0ee4a6fbea tempest-AttachVolumeNegativeTest-1260692363 None] Lock "cinder-a94c8918-6afb-43e6-8d61-c0dcafa4d338-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:31 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_5e9lbt4fdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:31 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Temporary image d659fbbf-f540-415a-bb1b-8ef207a29f4e is fetched for user 724cb1ff2287487486718d015c6edd4c. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:09:31 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e94eab-1ee4-47d5-8050-32bd1327286c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_5e9lbt4fdevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:31 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_5e9lbt4fdevstack@QuobyteHD Sep 28 17:09:31 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "cinder-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:31 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] Lock "cinder-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_5e9lbt4fdevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1838722466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3063ff00-3c62-485e-87c7-a8df475c2937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb823ea468ec40788c244ae5c7e5bbe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:29Z,use_quota=True,user_id='724cb1ff2287487486718d015c6edd4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Creating volume 3063ff00-3c62-485e-87c7-a8df475c2937 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:32 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:32 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937 1073741824 Sep 28 17:09:32 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "cinder-quobyte-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] Lock "cinder-quobyte-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8" acquired by "delete_volume" :: waited 0.049s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[1011f29a-13ed-43b7-9be9-387664eab8e3]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:32 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8 Sep 28 17:09:32 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:32 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937 1073741824" returned: 0 in 0.672s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:32 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8" returned: 0 in 0.523s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:32 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8 Sep 28 17:09:32 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:32 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937 Sep 28 17:09:32 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:33 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8" returned: 0 in 0.327s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] Lock "cinder-quobyte-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8" released by "delete_volume" :: held 0.941s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:33 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937" returned: 0 in 0.384s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Attempting download of d659fbbf-f540-415a-bb1b-8ef207a29f4e ((None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}])) to volume 3063ff00-3c62-485e-87c7-a8df475c2937. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] Created reservations ['e983e77b-ca28-426c-b3cc-9a2e474e1ff1', '1fc7a0b2-3cbb-4601-87e3-ef1ef7193afa', 'cbf43593-ac4d-422d-be19-b9b3880b47ad', 'becbe54c-f877-4bb8-9c15-ffee65da4a5d'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ac07e4-df3b-4caa-aaed-a783c2331db1]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_kimmuwbu {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:33 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:09:33 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:33 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_kimmuwbu Sep 28 17:09:33 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:33 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.276s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:33 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] Deleted volume successfully. Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cb0eb021-58b4-40c4-86e2-fb472630abba tempest-AttachVolumeNegativeTest-1260692363 None] Lock "cinder-0aef2be2-6816-4c99-8e22-47aa2cbe6ca8-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:33 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_kimmuwbu" returned: 0 in 0.593s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_kimmuwbu {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:34 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_kimmuwbu Sep 28 17:09:34 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:34 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_kimmuwbu" returned: 1 in 0.468s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_kimmuwbu' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:09:34 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[765d50ed-0c51-4827-ba02-806e062ac5ce]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_5e9lbt4fdevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:34 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_5e9lbt4fdevstack@QuobyteHD Sep 28 17:09:34 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:34 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_5e9lbt4fdevstack@QuobyteHD" returned: 0 in 0.500s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:34 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] d659fbbf-f540-415a-bb1b-8ef207a29f4e was qcow2, converting to qcow2 {{(pid=86970) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:09:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_5e9lbt4fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:34 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_5e9lbt4fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937 Sep 28 17:09:34 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:37 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_5e9lbt4fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937" returned: 0 in 2.910s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:37 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_5e9lbt4fdevstack@QuobyteHD, size 112.00 MB, duration 2.91 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937 {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:09:37 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Converted 112.00 MB image at 38.46 MB/s Sep 28 17:09:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:37 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937 1G Sep 28 17:09:37 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:38 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937 1G" returned: 0 in 0.490s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:38 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Downloaded image d659fbbf-f540-415a-bb1b-8ef207a29f4e ((None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}])) to volume 3063ff00-3c62-485e-87c7-a8df475c2937 successfully. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:09:38 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Temporary image d659fbbf-f540-415a-bb1b-8ef207a29f4e for user 724cb1ff2287487486718d015c6edd4c is deleted. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:09:38 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Marking volume 3063ff00-3c62-485e-87c7-a8df475c2937 as bootable. {{(pid=86970) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:09:38 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Copying metadata from image d659fbbf-f540-415a-bb1b-8ef207a29f4e to 3063ff00-3c62-485e-87c7-a8df475c2937. {{(pid=86970) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:09:38 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Creating volume glance metadata for volume 3063ff00-3c62-485e-87c7-a8df475c2937 backed by image d659fbbf-f540-415a-bb1b-8ef207a29f4e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86970) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:09:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca54fd9c-356d-4a87-a647-f42a12bf4a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3063ff00-3c62-485e-87c7-a8df475c2937', 'volume_size': 1, 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '280d624e0a3d44539d88968c5a0e8318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ae77c0-c04a-48a8-b688-db1a3faf1315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:38 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Volume volume-3063ff00-3c62-485e-87c7-a8df475c2937 (3063ff00-3c62-485e-87c7-a8df475c2937): created successfully Sep 28 17:09:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ae77c0-c04a-48a8-b688-db1a3faf1315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Flow 'volume_create_manager' (e756132c-8d4b-4e35-b654-dfb608c4711f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:38 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-9f4e5a5d-db0e-4e56-ae2c-64a24e2f1531 tempest-VolumesImageMetadata-1419015353 None] Created volume successfully. Sep 28 17:09:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] Acquiring lock "cinder-3063ff00-3c62-485e-87c7-a8df475c2937-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] Lock "cinder-3063ff00-3c62-485e-87c7-a8df475c2937-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] Acquiring lock "cinder-quobyte-3063ff00-3c62-485e-87c7-a8df475c2937" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] Lock "cinder-quobyte-3063ff00-3c62-485e-87c7-a8df475c2937" acquired by "delete_volume" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:40 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[753f3949-46b6-4884-85f0-fdd63f393584]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:40 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937 Sep 28 17:09:40 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:40 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937" returned: 0 in 0.558s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:40 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937 Sep 28 17:09:40 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:41 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3063ff00-3c62-485e-87c7-a8df475c2937" returned: 0 in 0.356s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] Lock "cinder-quobyte-3063ff00-3c62-485e-87c7-a8df475c2937" released by "delete_volume" :: held 0.981s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:41 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] Created reservations ['54714d30-d5a1-44e7-a288-16cb0901c343', '4e564205-7b15-423f-b35e-9a46199b25ba', '23b5a5c0-d353-490c-8aa2-b03aa69bc01d', 'e5ca9e6e-5218-44c1-8437-753445af6162'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:41 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:09:41 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:41 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.318s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:41 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:41 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] Deleted volume successfully. Sep 28 17:09:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dc692cdf-40c9-47c7-8267-accee544bddb tempest-VolumesImageMetadata-1419015353 None] Lock "cinder-3063ff00-3c62-485e-87c7-a8df475c2937-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Flow 'volume_create_manager' (b147fafa-3bf8-41dc-91d9-d2b22414b593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8711d3d3-36e9-4da1-b7a5-028b60d74397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8711d3d3-36e9-4da1-b7a5-028b60d74397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1243286055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f060d19-4bff-4a1d-9d3e-e1b79070d325,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='751297d348a5405fae9bd2142412b553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:50Z,use_quota=True,user_id='30f45a96deee401f9d9f9d1bc3b54d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d9a251-96fe-4daa-a799-7b5a9b0f3cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d9a251-96fe-4daa-a799-7b5a9b0f3cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48ad182-8947-47ee-8704-7b0cbc9d4418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48ad182-8947-47ee-8704-7b0cbc9d4418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f060d19-4bff-4a1d-9d3e-e1b79070d325', 'volume_name': 'volume-4f060d19-4bff-4a1d-9d3e-e1b79070d325', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7eb3fc-c405-4a46-9cde-d2b0a962ec75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7eb3fc-c405-4a46-9cde-d2b0a962ec75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62db19f-3556-469f-b8b0-008159a88924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:49 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Volume 4f060d19-4bff-4a1d-9d3e-e1b79070d325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f060d19-4bff-4a1d-9d3e-e1b79070d325', 'volume_size': 1} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1243286055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f060d19-4bff-4a1d-9d3e-e1b79070d325,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='751297d348a5405fae9bd2142412b553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:50Z,use_quota=True,user_id='30f45a96deee401f9d9f9d1bc3b54d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Creating volume 4f060d19-4bff-4a1d-9d3e-e1b79070d325 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:49 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:09:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4f060d19-4bff-4a1d-9d3e-e1b79070d325 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:49 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4f060d19-4bff-4a1d-9d3e-e1b79070d325 1073741824 Sep 28 17:09:49 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:50 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4f060d19-4bff-4a1d-9d3e-e1b79070d325 1073741824" returned: 0 in 0.595s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4f060d19-4bff-4a1d-9d3e-e1b79070d325 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:50 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4f060d19-4bff-4a1d-9d3e-e1b79070d325 Sep 28 17:09:50 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:50 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4f060d19-4bff-4a1d-9d3e-e1b79070d325" returned: 0 in 0.296s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62db19f-3556-469f-b8b0-008159a88924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f060d19-4bff-4a1d-9d3e-e1b79070d325', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304a0a9d-2782-4934-b272-76ee31626174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:50 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Volume volume-4f060d19-4bff-4a1d-9d3e-e1b79070d325 (4f060d19-4bff-4a1d-9d3e-e1b79070d325): created successfully Sep 28 17:09:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304a0a9d-2782-4934-b272-76ee31626174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Flow 'volume_create_manager' (b147fafa-3bf8-41dc-91d9-d2b22414b593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:50 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-7a754bf1-5e82-4f85-942c-107d11c6a96d req-a1671116-b4d1-478b-91a8-e196695b3922 tempest-VolumesGetTestJSON-894774729 None] Created volume successfully. Sep 28 17:09:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] Acquiring lock "cinder-4f060d19-4bff-4a1d-9d3e-e1b79070d325-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] Lock "cinder-4f060d19-4bff-4a1d-9d3e-e1b79070d325-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] Acquiring lock "cinder-quobyte-4f060d19-4bff-4a1d-9d3e-e1b79070d325" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] Lock "cinder-quobyte-4f060d19-4bff-4a1d-9d3e-e1b79070d325" acquired by "delete_volume" :: waited 0.031s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:52 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73fa054-2f08-4f8d-b79d-124d74a5c256]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4f060d19-4bff-4a1d-9d3e-e1b79070d325 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Flow 'volume_create_manager' (a0c27846-c29d-4374-b37c-c9d39a934893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5706dd-20a6-49b4-975d-5baaa6ce9c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5706dd-20a6-49b4-975d-5baaa6ce9c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1817575290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ecdb43-8a46-4491-a9ac-a7890b720289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95270ab762024729a51b63c673ec0a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:53Z,use_quota=True,user_id='61b5643bb85f47799ad951f965fa136a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d12f5bc-bd7a-4bde-9b94-933c99e199f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d12f5bc-bd7a-4bde-9b94-933c99e199f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:53 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4f060d19-4bff-4a1d-9d3e-e1b79070d325 Sep 28 17:09:53 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bf4c6a-36c0-4699-9b34-a75d20881519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bf4c6a-36c0-4699-9b34-a75d20881519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7ecdb43-8a46-4491-a9ac-a7890b720289', 'volume_name': 'volume-d7ecdb43-8a46-4491-a9ac-a7890b720289', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16acd54-67a7-410e-a454-7a6f57beff8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16acd54-67a7-410e-a454-7a6f57beff8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a88e97d-92ac-4e9e-812e-f12fd2768818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:53 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Volume d7ecdb43-8a46-4491-a9ac-a7890b720289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7ecdb43-8a46-4491-a9ac-a7890b720289', 'volume_size': 1} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1817575290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ecdb43-8a46-4491-a9ac-a7890b720289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95270ab762024729a51b63c673ec0a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:53Z,use_quota=True,user_id='61b5643bb85f47799ad951f965fa136a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Creating volume d7ecdb43-8a46-4491-a9ac-a7890b720289 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:53 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d7ecdb43-8a46-4491-a9ac-a7890b720289 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:53 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d7ecdb43-8a46-4491-a9ac-a7890b720289 1073741824 Sep 28 17:09:53 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:53 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4f060d19-4bff-4a1d-9d3e-e1b79070d325" returned: 0 in 0.704s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4f060d19-4bff-4a1d-9d3e-e1b79070d325 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:53 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4f060d19-4bff-4a1d-9d3e-e1b79070d325 Sep 28 17:09:53 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:54 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d7ecdb43-8a46-4491-a9ac-a7890b720289 1073741824" returned: 0 in 0.759s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:54 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4f060d19-4bff-4a1d-9d3e-e1b79070d325" returned: 0 in 0.475s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d7ecdb43-8a46-4491-a9ac-a7890b720289 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] Lock "cinder-quobyte-4f060d19-4bff-4a1d-9d3e-e1b79070d325" released by "delete_volume" :: held 1.289s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:54 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d7ecdb43-8a46-4491-a9ac-a7890b720289 Sep 28 17:09:54 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG cinder.quota [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] Created reservations ['4d165f05-570c-4de3-85c0-5667c4bcf937', 'f52a1711-4683-4607-a104-b0a55d892bb0', '1ab338f8-22ad-4956-8818-affdc9416394', 'a7e1309d-8ddc-4a39-8c47-8d8ac530540b'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:54 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:09:54 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:54 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d7ecdb43-8a46-4491-a9ac-a7890b720289" returned: 0 in 0.355s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a88e97d-92ac-4e9e-812e-f12fd2768818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ecdb43-8a46-4491-a9ac-a7890b720289', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259cccdd-3fb6-4664-96f1-b857b49f3640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:54 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Volume volume-d7ecdb43-8a46-4491-a9ac-a7890b720289 (d7ecdb43-8a46-4491-a9ac-a7890b720289): created successfully Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259cccdd-3fb6-4664-96f1-b857b49f3640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Flow 'volume_create_manager' (a0c27846-c29d-4374-b37c-c9d39a934893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:54 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ff1c8459-a8d0-4894-bb9c-61f011a040e1 tempest-VolumesTransfersV355Test-1874355310 None] Created volume successfully. Sep 28 17:09:54 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.349s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG cinder.manager [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:54 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] Deleted volume successfully. Sep 28 17:09:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-129055ef-176b-4bfc-8efb-fade04c2f8fa req-1f43fc0a-557d-4e90-a007-da7482b92afd tempest-VolumesGetTestJSON-894774729 None] Lock "cinder-4f060d19-4bff-4a1d-9d3e-e1b79070d325-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:56 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-11643acd-ade3-460c-8cca-54c02658c102 tempest-VolumesTransfersV355Test-1683818208 None] Transfer volume completed successfully. Sep 28 17:09:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] Acquiring lock "cinder-d7ecdb43-8a46-4491-a9ac-a7890b720289-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] Lock "cinder-d7ecdb43-8a46-4491-a9ac-a7890b720289-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:57 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:INSERT=39,cinder:UPDATE=135,cinder:SELECT=87,cinder:DELETE=7 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:09:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] Acquiring lock "cinder-quobyte-d7ecdb43-8a46-4491-a9ac-a7890b720289" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] Lock "cinder-quobyte-d7ecdb43-8a46-4491-a9ac-a7890b720289" acquired by "delete_volume" :: waited 0.022s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:57 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f432ad9-72c1-494b-ad3e-335a040e5761]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d7ecdb43-8a46-4491-a9ac-a7890b720289 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:58 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d7ecdb43-8a46-4491-a9ac-a7890b720289 Sep 28 17:09:58 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=98,cinder:INSERT=29,cinder:UPDATE=117,cinder:DELETE=14 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:09:58 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d7ecdb43-8a46-4491-a9ac-a7890b720289" returned: 0 in 0.596s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d7ecdb43-8a46-4491-a9ac-a7890b720289 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:58 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d7ecdb43-8a46-4491-a9ac-a7890b720289 Sep 28 17:09:58 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Flow 'volume_create_manager' (42fc4d53-ff21-4272-871b-b25ea691f10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8898dfb-7766-4860-96f2-770de63ab944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8898dfb-7766-4860-96f2-770de63ab944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-295049716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b03ba2-4f92-432f-84d0-711fd15bd0d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26196d489e704ef7b5dc1445e8174243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:58Z,use_quota=True,user_id='0f3ed065188c4e7ca08333ce63aba929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78a082f-0927-4bfd-a75a-29b943831eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78a082f-0927-4bfd-a75a-29b943831eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e226b3-6888-4b48-9200-db2337e7938e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e226b3-6888-4b48-9200-db2337e7938e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b03ba2-4f92-432f-84d0-711fd15bd0d7', 'volume_name': 'volume-05b03ba2-4f92-432f-84d0-711fd15bd0d7', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4b16bb-039d-4104-8a37-e41a7269dbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4b16bb-039d-4104-8a37-e41a7269dbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3d7048-227e-48c7-95e2-00c2fbda85c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:58 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Volume 05b03ba2-4f92-432f-84d0-711fd15bd0d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b03ba2-4f92-432f-84d0-711fd15bd0d7', 'volume_size': 1} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-295049716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b03ba2-4f92-432f-84d0-711fd15bd0d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26196d489e704ef7b5dc1445e8174243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:58Z,use_quota=True,user_id='0f3ed065188c4e7ca08333ce63aba929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Creating volume 05b03ba2-4f92-432f-84d0-711fd15bd0d7 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:58 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-05b03ba2-4f92-432f-84d0-711fd15bd0d7 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:58 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-05b03ba2-4f92-432f-84d0-711fd15bd0d7 1073741824 Sep 28 17:09:58 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:58 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d7ecdb43-8a46-4491-a9ac-a7890b720289" returned: 0 in 0.370s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] Lock "cinder-quobyte-d7ecdb43-8a46-4491-a9ac-a7890b720289" released by "delete_volume" :: held 1.051s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:58 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] Created reservations ['53ef26f9-ca24-4543-bf61-ff18b6c1b23f', '23b235e9-f589-4c73-9561-f94c8be0e719', '8ce11e00-0177-498e-a549-2121a521657f', 'fd1bcf5f-43ef-42e4-8092-28614131b33b'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:59 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:09:59 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:59 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-05b03ba2-4f92-432f-84d0-711fd15bd0d7 1073741824" returned: 0 in 0.743s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-05b03ba2-4f92-432f-84d0-711fd15bd0d7 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:59 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.356s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:59 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-05b03ba2-4f92-432f-84d0-711fd15bd0d7 Sep 28 17:09:59 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:59 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] Deleted volume successfully. Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-322da1e1-0fb9-436d-ae08-0f4704d94c71 tempest-VolumesTransfersV355Test-1132401431 None] Lock "cinder-d7ecdb43-8a46-4491-a9ac-a7890b720289-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:59 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-05b03ba2-4f92-432f-84d0-711fd15bd0d7" returned: 0 in 0.314s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3d7048-227e-48c7-95e2-00c2fbda85c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b03ba2-4f92-432f-84d0-711fd15bd0d7', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e237f9-d4f2-4e53-8711-407f9bba9ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:59 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Volume volume-05b03ba2-4f92-432f-84d0-711fd15bd0d7 (05b03ba2-4f92-432f-84d0-711fd15bd0d7): created successfully Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e237f9-d4f2-4e53-8711-407f9bba9ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Flow 'volume_create_manager' (42fc4d53-ff21-4272-871b-b25ea691f10a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:59 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-60907dc6-fab2-415e-94ce-e92a2a9f6dd9 tempest-AbsoluteLimitsTests-577998945 None] Created volume successfully. Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:01 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:10:01 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Flow 'volume_create_manager' (c5f8c687-24e1-4e3f-a113-851517f6092e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f45660f-f567-41d4-8261-3e7cd3550a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Flow 'volume_create_manager' (81a965ba-4830-46af-af37-c90d9cea8dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a489d150-1131-4427-9803-e4a9623de0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] Acquiring lock "cinder-05b03ba2-4f92-432f-84d0-711fd15bd0d7-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a489d150-1131-4427-9803-e4a9623de0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-472874693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb506fd-fcfc-4f70-b541-864a9094cbd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd59e6afec66496ba35bae78d9053234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:01Z,use_quota=True,user_id='4b3c0e05c448469c82d26b3dff304fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476d6759-8991-4b2b-94f4-d492d29e8644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476d6759-8991-4b2b-94f4-d492d29e8644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78cb7443-dc5e-49e1-9c8a-49790da37ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78cb7443-dc5e-49e1-9c8a-49790da37ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eb506fd-fcfc-4f70-b541-864a9094cbd6', 'volume_name': 'volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83af730c-ae7d-4703-8d2d-98e6c5f03103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83af730c-ae7d-4703-8d2d-98e6c5f03103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:01 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5ade5e-792d-4eca-a436-45057fa8b918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:01 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Volume 6eb506fd-fcfc-4f70-b541-864a9094cbd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6', 'volume_size': 1} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-472874693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb506fd-fcfc-4f70-b541-864a9094cbd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd59e6afec66496ba35bae78d9053234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:01Z,use_quota=True,user_id='4b3c0e05c448469c82d26b3dff304fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Creating volume 6eb506fd-fcfc-4f70-b541-864a9094cbd6 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:01 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f45660f-f567-41d4-8261-3e7cd3550a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-896708313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c4ab8c-a1cd-41b9-861b-ccfd8be34806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95270ab762024729a51b63c673ec0a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:01Z,use_quota=True,user_id='61b5643bb85f47799ad951f965fa136a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97faba1-09df-4d1c-976f-ef5aacb6bc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:01 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6 1073741824 Sep 28 17:10:01 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97faba1-09df-4d1c-976f-ef5aacb6bc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69483876-7132-4b96-8ecb-560ce44976cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69483876-7132-4b96-8ecb-560ce44976cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2c4ab8c-a1cd-41b9-861b-ccfd8be34806', 'volume_name': 'volume-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff22babf-8e09-40a0-996d-95809742486c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff22babf-8e09-40a0-996d-95809742486c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d0a78d-d1da-430a-8897-408f46e01d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:01 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Volume e2c4ab8c-a1cd-41b9-861b-ccfd8be34806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806', 'volume_size': 1} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.500s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] Lock "cinder-05b03ba2-4f92-432f-84d0-711fd15bd0d7-delete_volume" acquired by "delete_volume" :: waited 0.178s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] Acquiring lock "cinder-quobyte-05b03ba2-4f92-432f-84d0-711fd15bd0d7" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] Lock "cinder-quobyte-05b03ba2-4f92-432f-84d0-711fd15bd0d7" acquired by "delete_volume" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb6e219-aa88-4793-8764-5e08ad9e53d1]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-05b03ba2-4f92-432f-84d0-711fd15bd0d7 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b77e9b51-14d2-4121-b186-d7d1e53772d5 tempest-BackendsCapabilitiesAdminTestsJSON-615206477 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.153060913086, 'free_capacity_gb': 1775.153060913086, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86970) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:10:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e2c5b6cc-0927-43ec-868f-e6ca71537ffd tempest-BackendsCapabilitiesAdminTestsJSON-615206477 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.153060913086, 'free_capacity_gb': 1775.153060913086, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86970) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:10:01 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-05b03ba2-4f92-432f-84d0-711fd15bd0d7 Sep 28 17:10:01 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:02 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6 1073741824" returned: 0 in 0.677s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:02 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6 Sep 28 17:10:02 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:02 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-05b03ba2-4f92-432f-84d0-711fd15bd0d7" returned: 0 in 0.566s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-05b03ba2-4f92-432f-84d0-711fd15bd0d7 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:02 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-05b03ba2-4f92-432f-84d0-711fd15bd0d7 Sep 28 17:10:02 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:02 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6" returned: 0 in 0.320s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-896708313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c4ab8c-a1cd-41b9-861b-ccfd8be34806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95270ab762024729a51b63c673ec0a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:01Z,use_quota=True,user_id='61b5643bb85f47799ad951f965fa136a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Creating volume e2c4ab8c-a1cd-41b9-861b-ccfd8be34806 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:02 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:02 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5ade5e-792d-4eca-a436-45057fa8b918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:02 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806 1073741824 Sep 28 17:10:02 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203f39ef-26bc-4da4-8bb8-78a3a8c9b3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-05b03ba2-4f92-432f-84d0-711fd15bd0d7" returned: 0 in 0.337s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] Lock "cinder-quobyte-05b03ba2-4f92-432f-84d0-711fd15bd0d7" released by "delete_volume" :: held 0.979s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:02 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Volume volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6 (6eb506fd-fcfc-4f70-b541-864a9094cbd6): created successfully Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203f39ef-26bc-4da4-8bb8-78a3a8c9b3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Flow 'volume_create_manager' (81a965ba-4830-46af-af37-c90d9cea8dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:02 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1f3a0258-0ad7-41b7-8e54-5510dd12c1d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Created volume successfully. Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] Created reservations ['f593a4bf-1399-4020-8e1c-3049903d94c3', 'b24de9b2-cf3e-4366-9fd1-4ed004cb0f97', '81f2954e-33d3-495d-b522-872fc525e5a5', '863ed3be-1fc0-41a3-94d9-6d07e7a01dc5'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:02 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:10:02 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:03 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.357s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:03 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:03 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] Deleted volume successfully. Sep 28 17:10:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-181087c7-705b-411e-bc7e-8009981cb139 tempest-AbsoluteLimitsTests-577998945 None] Lock "cinder-05b03ba2-4f92-432f-84d0-711fd15bd0d7-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:03 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806 1073741824" returned: 0 in 0.742s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:03 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806 Sep 28 17:10:03 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:03 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806" returned: 0 in 0.285s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.242s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Creating offline snapshot a9105f72-6366-457f-b2b4-b61c16cedff1 of volume 6eb506fd-fcfc-4f70-b541-864a9094cbd6 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:10:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d0a78d-d1da-430a-8897-408f46e01d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec624ffa-e76e-4206-a927-59fcf8f61442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:03 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d82c29-6715-429b-9cbd-517bec731d87]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:03 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Volume volume-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806 (e2c4ab8c-a1cd-41b9-861b-ccfd8be34806): created successfully Sep 28 17:10:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec624ffa-e76e-4206-a927-59fcf8f61442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Flow 'volume_create_manager' (c5f8c687-24e1-4e3f-a113-851517f6092e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:03 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-e541eecc-9b19-4acb-8d4b-8658467b2b7a tempest-VolumesTransfersV355Test-1874355310 None] Created volume successfully. Sep 28 17:10:03 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6 Sep 28 17:10:03 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:04 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6" returned: 0 in 0.592s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:04 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1 1G Sep 28 17:10:04 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] Acquiring lock "cinder-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] Lock "cinder-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] Acquiring lock "cinder-quobyte-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] Lock "cinder-quobyte-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806" acquired by "delete_volume" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:04 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb26a64d-8dd2-4e1e-a8ce-85d73ede5072]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:05 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806 Sep 28 17:10:05 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:05 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1 1G" returned: 0 in 0.671s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:05 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1 Sep 28 17:10:05 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:05 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806" returned: 0 in 0.497s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:05 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806 Sep 28 17:10:05 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:05 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1" returned: 0 in 0.455s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:05 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1 is being set with open permissions: ugo+rw Sep 28 17:10:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:05 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1 Sep 28 17:10:05 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:05 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806" returned: 0 in 0.441s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] Lock "cinder-quobyte-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806" released by "delete_volume" :: held 1.019s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:05 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1" returned: 0 in 0.391s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:06 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] Created reservations ['53241d54-8fe7-4860-b13f-00c4547623e1', '0514b39b-c4e1-4426-97f9-e838337347ae', 'b580f987-b576-448d-9218-8293160b4f4c', 'b4eb4ca5-3a85-4104-8336-0a9bc107fbdc'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:06 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.info Sep 28 17:10:06 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:06 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:10:06 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:06 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.info" returned: 0 in 0.368s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:06 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.info is being set with open permissions: ugo+rw Sep 28 17:10:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:06 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.info Sep 28 17:10:06 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:06 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.439s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:06 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:06 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] Deleted volume successfully. Sep 28 17:10:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-541abb06-3f69-447e-8d02-393fd21975cd tempest-VolumesTransfersV355Test-1132401431 None] Lock "cinder-e2c4ab8c-a1cd-41b9-861b-ccfd8be34806-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:06 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.info" returned: 0 in 0.471s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.147s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:06 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1e4d2753-c301-4602-bbb3-690f1937796d tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Create snapshot completed successfully Sep 28 17:10:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Acquiring lock "cinder-a9105f72-6366-457f-b2b4-b61c16cedff1-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "cinder-a9105f72-6366-457f-b2b4-b61c16cedff1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Acquiring lock "cinder-quobyte-6eb506fd-fcfc-4f70-b541-864a9094cbd6" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "cinder-quobyte-6eb506fd-fcfc-4f70-b541-864a9094cbd6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Acquiring lock "cinder-quobyte-a9105f72-6366-457f-b2b4-b61c16cedff1" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "cinder-quobyte-a9105f72-6366-457f-b2b4-b61c16cedff1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Deleting offline snapshot a9105f72-6366-457f-b2b4-b61c16cedff1 of volume 6eb506fd-fcfc-4f70-b541-864a9094cbd6 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:10:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] snapshot_file for this snap is: volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:10:08 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d43094-3a58-4a13-a72e-30318a0dd5cd]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:08 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1 Sep 28 17:10:08 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:09 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1" returned: 0 in 0.516s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:10:09 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d4771e-9b11-4138-9120-aafa887d0c1a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:09 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6 Sep 28 17:10:09 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:09 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6" returned: 0 in 0.547s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:09 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1 Sep 28 17:10:09 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:10 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1" returned: 0 in 0.591s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:10 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1 Sep 28 17:10:10 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:10 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6.a9105f72-6366-457f-b2b4-b61c16cedff1" returned: 0 in 0.358s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "cinder-quobyte-a9105f72-6366-457f-b2b4-b61c16cedff1" released by "_delete_snapshot" :: held 2.188s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "cinder-quobyte-6eb506fd-fcfc-4f70-b541-864a9094cbd6" released by "delete_snapshot" :: held 2.215s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:10 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Created reservations ['3e7c62bf-afdc-440f-b077-468d73219d53', '3ded759f-ade8-4dfa-a3d6-c4a1e6afa99e', 'fbb75616-89dc-45a0-92f1-9c42b49f1d09', 'b16ecf6a-9469-4191-997d-96458b7c8182'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:10 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Delete snapshot completed successfully. Sep 28 17:10:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8e920788-b561-4247-97ce-c1d7ebfef14c tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "cinder-a9105f72-6366-457f-b2b4-b61c16cedff1-delete_snapshot" released by "delete_snapshot" :: held 2.506s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Acquiring lock "cinder-6eb506fd-fcfc-4f70-b541-864a9094cbd6-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "cinder-6eb506fd-fcfc-4f70-b541-864a9094cbd6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:12 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Acquiring lock "cinder-quobyte-6eb506fd-fcfc-4f70-b541-864a9094cbd6" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:12 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "cinder-quobyte-6eb506fd-fcfc-4f70-b541-864a9094cbd6" acquired by "delete_volume" :: waited 0.050s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:12 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[c415b3bc-24a1-4b17-a743-eed26626976c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:12 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6 Sep 28 17:10:12 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:12 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3bbd63b8-88c0-4a30-a45c-b303a05cc312 tempest-GroupSnapshotsV319Test-860136176 None] Group tempest-GroupSnapshotsV319Test-Group-527568135: creating Sep 28 17:10:12 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3bbd63b8-88c0-4a30-a45c-b303a05cc312 tempest-GroupSnapshotsV319Test-860136176 None] Group tempest-GroupSnapshotsV319Test-Group-527568135: created successfully Sep 28 17:10:12 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3bbd63b8-88c0-4a30-a45c-b303a05cc312 tempest-GroupSnapshotsV319Test-860136176 None] Create group completed successfully. Sep 28 17:10:12 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6" returned: 0 in 0.561s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:12 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6 Sep 28 17:10:12 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:13 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6eb506fd-fcfc-4f70-b541-864a9094cbd6" returned: 0 in 0.374s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "cinder-quobyte-6eb506fd-fcfc-4f70-b541-864a9094cbd6" released by "delete_volume" :: held 1.058s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:13 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Created reservations ['35e45bc2-903e-42df-af44-bdb8ed4ef4f8', '73fa1954-e3ed-459b-99e6-7f069cb6f167', '2f4cb386-74ea-4ecb-b12c-d02695f1d7ed', '3adcfdf0-2b47-4096-b7e7-e4af151ae33c'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:13 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:13 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:13 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:10:13 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:13 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.445s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:13 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:13 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Deleted volume successfully. Sep 28 17:10:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-dd09f240-8008-45f6-9808-a37f3da6c5d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-782531862 None] Lock "cinder-6eb506fd-fcfc-4f70-b541-864a9094cbd6-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Flow 'volume_create_manager' (7c7bfc71-0e2e-4f9d-a147-cb6dce6dfafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad965919-6eb5-4dd3-9134-8a1aea55b56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad965919-6eb5-4dd3-9134-8a1aea55b56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-402988112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=90ad0f25-d106-47ec-a123-bd70e45f4283,host='devstack@QuobyteHD#QuobyteHD',id=01b78eee-bdfe-4e51-be29-122b34b2775d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='005faa5c2ec346ec9908dbda894ad433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:14Z,use_quota=True,user_id='2b7f375f24d3438081e0483b13942c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(623dbfb2-bdd4-4169-abfb-c8b3ef8c9ce0),volume_type_id=623dbfb2-bdd4-4169-abfb-c8b3ef8c9ce0)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588699c0-0e0c-4288-8cce-2062bbf5d8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588699c0-0e0c-4288-8cce-2062bbf5d8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf8e225-41ec-4089-9277-7022efde0adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf8e225-41ec-4089-9277-7022efde0adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b78eee-bdfe-4e51-be29-122b34b2775d', 'volume_name': 'volume-01b78eee-bdfe-4e51-be29-122b34b2775d', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2eff6a6-6888-4391-8792-9860f56d697f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2eff6a6-6888-4391-8792-9860f56d697f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b2bb39-35ac-41c8-bd6f-0746221ea14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:14 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Volume 01b78eee-bdfe-4e51-be29-122b34b2775d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b78eee-bdfe-4e51-be29-122b34b2775d', 'volume_size': 1} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=90ad0f25-d106-47ec-a123-bd70e45f4283,created_at=2026-09-28T15:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-402988112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=90ad0f25-d106-47ec-a123-bd70e45f4283,host='devstack@QuobyteHD#QuobyteHD',id=01b78eee-bdfe-4e51-be29-122b34b2775d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='005faa5c2ec346ec9908dbda894ad433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:14Z,use_quota=True,user_id='2b7f375f24d3438081e0483b13942c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(623dbfb2-bdd4-4169-abfb-c8b3ef8c9ce0),volume_type_id=623dbfb2-bdd4-4169-abfb-c8b3ef8c9ce0)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Creating volume 01b78eee-bdfe-4e51-be29-122b34b2775d {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:14 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:10:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:14 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d 1073741824 Sep 28 17:10:14 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:15 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d 1073741824" returned: 0 in 0.669s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:15 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d Sep 28 17:10:15 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:15 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d" returned: 0 in 0.423s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b2bb39-35ac-41c8-bd6f-0746221ea14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b78eee-bdfe-4e51-be29-122b34b2775d', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df76e667-e0c4-4350-9338-92bf8f61baa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:15 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Volume volume-01b78eee-bdfe-4e51-be29-122b34b2775d (01b78eee-bdfe-4e51-be29-122b34b2775d): created successfully Sep 28 17:10:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df76e667-e0c4-4350-9338-92bf8f61baa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Flow 'volume_create_manager' (7c7bfc71-0e2e-4f9d-a147-cb6dce6dfafa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:15 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-fb28c2a4-8cc7-41b2-a52d-24c8520c71c3 tempest-GroupSnapshotsV319Test-860136176 None] Created volume successfully. Sep 28 17:10:17 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] GroupSnapshot c7eea204-b3a5-4dff-962c-4430929bf5ac: creating. Sep 28 17:10:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] Group snapshot c7eea204-b3a5-4dff-962c-4430929bf5ac: creating. {{(pid=86970) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:10:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] Creating offline snapshot 77701f04-3308-4519-affa-b2c26c18de32 of volume 01b78eee-bdfe-4e51-be29-122b34b2775d {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:10:17 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[93233b07-1ca1-49f9-8599-8af6d44cd5d7]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:17 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d Sep 28 17:10:17 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:18 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d" returned: 0 in 0.567s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:18 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32 1G Sep 28 17:10:18 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:18 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32 1G" returned: 0 in 0.797s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b78eee-bdfe-4e51-be29-122b34b2775d -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:18 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b78eee-bdfe-4e51-be29-122b34b2775d -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32 Sep 28 17:10:18 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:19 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b78eee-bdfe-4e51-be29-122b34b2775d -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32" returned: 0 in 0.474s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:19 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:10:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:19 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32 Sep 28 17:10:19 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:19 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32" returned: 0 in 0.418s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:19 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.info Sep 28 17:10:19 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:20 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.info" returned: 0 in 0.576s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:20 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:10:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:20 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.info Sep 28 17:10:20 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:20 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.info" returned: 0 in 0.355s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.367s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:20 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ac17547e-ab6e-45ef-b113-ae34c619f462 tempest-GroupSnapshotsV319Test-860136176 None] group_snapshot c7eea204-b3a5-4dff-962c-4430929bf5ac: created successfully Sep 28 17:10:20 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Flow 'volume_create_manager' (a2d12c7f-e114-4bdb-8756-5a7823c2fade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d166a2f-efcf-4ec5-b1aa-5ec1623971ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d166a2f-efcf-4ec5-b1aa-5ec1623971ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1227543193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06ed9f57-af81-4204-9d40-be391d5a199d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19dec55f19064ea7bd557357d03d2480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:21Z,use_quota=True,user_id='1bf555197e6f49e5bec7ca4fb3d6f154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24098d01-e275-4294-8b9f-3b20db58f5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24098d01-e275-4294-8b9f-3b20db58f5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e182ba-6559-4266-88eb-f5cc862f79ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e182ba-6559-4266-88eb-f5cc862f79ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06ed9f57-af81-4204-9d40-be391d5a199d', 'volume_name': 'volume-06ed9f57-af81-4204-9d40-be391d5a199d', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c3845b-4194-4f62-92dc-d3896c49996b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c3845b-4194-4f62-92dc-d3896c49996b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854e79dc-ca1c-48f9-bd45-e18fee1bae2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:21 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Volume 06ed9f57-af81-4204-9d40-be391d5a199d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06ed9f57-af81-4204-9d40-be391d5a199d', 'volume_size': 1} Sep 28 17:10:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1227543193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06ed9f57-af81-4204-9d40-be391d5a199d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19dec55f19064ea7bd557357d03d2480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:21Z,use_quota=True,user_id='1bf555197e6f49e5bec7ca4fb3d6f154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Creating volume 06ed9f57-af81-4204-9d40-be391d5a199d {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:21 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:10:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-06ed9f57-af81-4204-9d40-be391d5a199d 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:21 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-06ed9f57-af81-4204-9d40-be391d5a199d 1073741824 Sep 28 17:10:21 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:21 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-06ed9f57-af81-4204-9d40-be391d5a199d 1073741824" returned: 0 in 0.809s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-06ed9f57-af81-4204-9d40-be391d5a199d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:21 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-06ed9f57-af81-4204-9d40-be391d5a199d Sep 28 17:10:21 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:22 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-06ed9f57-af81-4204-9d40-be391d5a199d" returned: 0 in 0.418s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854e79dc-ca1c-48f9-bd45-e18fee1bae2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06ed9f57-af81-4204-9d40-be391d5a199d', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36437bf-c150-468f-b361-848e1ab9670e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:22 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Volume volume-06ed9f57-af81-4204-9d40-be391d5a199d (06ed9f57-af81-4204-9d40-be391d5a199d): created successfully Sep 28 17:10:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36437bf-c150-468f-b361-848e1ab9670e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Flow 'volume_create_manager' (a2d12c7f-e114-4bdb-8756-5a7823c2fade) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:22 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-aa2b1102-d585-4aeb-a963-7f18a809ea22 tempest-VolumesTransfersV357Test-504101305 None] Created volume successfully. Sep 28 17:10:22 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] group_snapshot c7eea204-b3a5-4dff-962c-4430929bf5ac: deleting Sep 28 17:10:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] group_snapshot c7eea204-b3a5-4dff-962c-4430929bf5ac: deleting {{(pid=86970) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:10:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] Acquiring lock "cinder-quobyte-01b78eee-bdfe-4e51-be29-122b34b2775d" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] Lock "cinder-quobyte-01b78eee-bdfe-4e51-be29-122b34b2775d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] Acquiring lock "cinder-quobyte-77701f04-3308-4519-affa-b2c26c18de32" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] Lock "cinder-quobyte-77701f04-3308-4519-affa-b2c26c18de32" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] Deleting offline snapshot 77701f04-3308-4519-affa-b2c26c18de32 of volume 01b78eee-bdfe-4e51-be29-122b34b2775d {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:10:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] snapshot_file for this snap is: volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:10:22 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7f46d9-207b-424b-b07f-7edea8787fe7]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:22 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32 Sep 28 17:10:22 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:23 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32" returned: 0 in 0.634s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:23 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b78eee-bdfe-4e51-be29-122b34b2775d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:10:23 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a593d9-1212-4043-bcd3-f040e288b23f]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:23 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d Sep 28 17:10:23 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:24 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d" returned: 0 in 0.668s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:24 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32 Sep 28 17:10:24 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:24 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-173fb35a-2a3b-4a62-9312-5864b87e8542 tempest-VolumesTransfersV357Test-109611722 None] Transfer volume completed successfully. Sep 28 17:10:24 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32" returned: 0 in 0.681s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:24 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32 Sep 28 17:10:24 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:25 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d.77701f04-3308-4519-affa-b2c26c18de32" returned: 0 in 0.570s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:25 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] Lock "cinder-quobyte-77701f04-3308-4519-affa-b2c26c18de32" released by "_delete_snapshot" :: held 2.736s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:25 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] Lock "cinder-quobyte-01b78eee-bdfe-4e51-be29-122b34b2775d" released by "delete_snapshot" :: held 2.787s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:25 devstack cinder-volume[86970]: WARNING cinder.quota [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1663548200 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1663548200, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:10:25 devstack cinder-volume[86970]: WARNING cinder.quota [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1663548200 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1663548200, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:10:25 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] Created reservations ['3d9ed8dc-fcfa-456b-9e43-47f1622cb1a9', '607f5a6e-2f8c-472e-888c-40d600724ad6', 'bafc1d86-4a05-4fcf-a140-17b50a5fbea8', '8f7716f9-7491-4a93-ab17-158670e6eaab'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:25 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-9079d9cd-6512-49c8-b078-a37b6c250dce tempest-GroupSnapshotsV319Test-860136176 None] group_snapshot c7eea204-b3a5-4dff-962c-4430929bf5ac: deleted successfully Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] Acquiring lock "cinder-06ed9f57-af81-4204-9d40-be391d5a199d-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] Lock "cinder-06ed9f57-af81-4204-9d40-be391d5a199d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Flow 'volume_create_manager' (6eedce5d-6931-4e93-b211-f92e740ed591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5c420a-e303-4ead-bdbb-1928f2b19296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5c420a-e303-4ead-bdbb-1928f2b19296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-962685100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5767b3b3-3df4-4116-a98b-904f10320f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be7bda28178540b9937faf4d780e7e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:26Z,use_quota=True,user_id='2cd4b3c5a7544a40bc576205b4002e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a69239-9421-4313-860e-da0202ddab98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a69239-9421-4313-860e-da0202ddab98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afa9af4-64ca-4307-a082-c778f1344d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afa9af4-64ca-4307-a082-c778f1344d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5767b3b3-3df4-4116-a98b-904f10320f46', 'volume_name': 'volume-5767b3b3-3df4-4116-a98b-904f10320f46', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3118662e-fad8-4f75-84b4-df075473844f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3118662e-fad8-4f75-84b4-df075473844f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050524fd-230e-490f-8c6f-f10f4e7768bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:26 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Volume 5767b3b3-3df4-4116-a98b-904f10320f46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5767b3b3-3df4-4116-a98b-904f10320f46', 'volume_size': 1} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-962685100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5767b3b3-3df4-4116-a98b-904f10320f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be7bda28178540b9937faf4d780e7e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:26Z,use_quota=True,user_id='2cd4b3c5a7544a40bc576205b4002e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Creating volume 5767b3b3-3df4-4116-a98b-904f10320f46 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:26 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:26 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 1073741824 Sep 28 17:10:26 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] Acquiring lock "cinder-quobyte-06ed9f57-af81-4204-9d40-be391d5a199d" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] Lock "cinder-quobyte-06ed9f57-af81-4204-9d40-be391d5a199d" acquired by "delete_volume" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79bb068-051b-4f91-aa25-6da70b0484f1]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-06ed9f57-af81-4204-9d40-be391d5a199d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:26 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-06ed9f57-af81-4204-9d40-be391d5a199d Sep 28 17:10:26 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] Acquiring lock "cinder-quobyte-01b78eee-bdfe-4e51-be29-122b34b2775d" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] Lock "cinder-quobyte-01b78eee-bdfe-4e51-be29-122b34b2775d" acquired by "delete_volume" :: waited 0.031s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:26 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 1073741824" returned: 0 in 0.614s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[6350ff60-8e97-4881-9cd9-f37ae466c0a5]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:26 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-06ed9f57-af81-4204-9d40-be391d5a199d" returned: 0 in 0.556s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-06ed9f57-af81-4204-9d40-be391d5a199d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:26 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-06ed9f57-af81-4204-9d40-be391d5a199d Sep 28 17:10:26 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:26 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 Sep 28 17:10:26 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:26 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d Sep 28 17:10:26 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:27 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46" returned: 0 in 0.371s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:27 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050524fd-230e-490f-8c6f-f10f4e7768bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5767b3b3-3df4-4116-a98b-904f10320f46', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d0d963-98db-4b9d-b049-237fe2c07dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-06ed9f57-af81-4204-9d40-be391d5a199d" returned: 0 in 0.457s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:27 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:27 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Volume volume-5767b3b3-3df4-4116-a98b-904f10320f46 (5767b3b3-3df4-4116-a98b-904f10320f46): created successfully Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d0d963-98db-4b9d-b049-237fe2c07dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Flow 'volume_create_manager' (6eedce5d-6931-4e93-b211-f92e740ed591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d" returned: 0 in 0.513s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] Lock "cinder-quobyte-06ed9f57-af81-4204-9d40-be391d5a199d" released by "delete_volume" :: held 1.095s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:27 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ca62f941-be09-451a-9a09-afb42ecefff0 tempest-VolumesActionsTest-2038700812 None] Created volume successfully. Sep 28 17:10:27 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d Sep 28 17:10:27 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] Created reservations ['b31f8409-966a-42a9-9c5b-15a3fe0427a5', '7793c62e-44fc-4e81-940a-3228e9ce26e3', '3ef295ff-0f57-40d3-856a-c85934578067', '896c275e-2e70-4110-9b19-8b8a70fad681'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:27 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:10:27 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:27 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-01b78eee-bdfe-4e51-be29-122b34b2775d" returned: 0 in 0.332s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] Lock "cinder-quobyte-01b78eee-bdfe-4e51-be29-122b34b2775d" released by "delete_volume" :: held 0.967s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:27 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.293s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:27 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] Deleted volume successfully. Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] Created reservations ['440ddb77-66e7-4d4c-b33a-14d1d0ff00e5'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8fb8dbb6-f06b-43b0-8ab3-06285c2d31d9 tempest-VolumesTransfersV357Test-1229121522 None] Lock "cinder-06ed9f57-af81-4204-9d40-be391d5a199d-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:27 devstack cinder-volume[86970]: WARNING cinder.quota [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1663548200 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1663548200, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:10:27 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] Created reservations ['286aa562-e5f6-447c-b3c0-1297c698c09c', '2ff01e41-735c-4ca3-a628-6dcfffdbf528', 'bfeb458a-90bd-40ce-9be1-c67d650b2bc3', '111c6b6a-1fe0-4b6c-80ca-64a28362e82e'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:28 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:10:28 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:28 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.286s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:28 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:28 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-df402425-ba3e-414c-808a-f4dce1230690 tempest-GroupSnapshotsV319Test-860136176 None] Delete group completed successfully. Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Flow 'volume_create_manager' (00c4becf-d32a-49f4-8748-ea98d1fba218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f7b326-9317-4eb3-9df8-6dd3215cc4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f7b326-9317-4eb3-9df8-6dd3215cc4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1899820286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1ca85d-0f20-40c9-9502-b68f1fbd8d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19dec55f19064ea7bd557357d03d2480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:29Z,use_quota=True,user_id='1bf555197e6f49e5bec7ca4fb3d6f154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea579575-da9a-4d62-bbc5-29a814725ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea579575-da9a-4d62-bbc5-29a814725ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3a219d-9205-4335-b9b6-66f4a26e71fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3a219d-9205-4335-b9b6-66f4a26e71fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1ca85d-0f20-40c9-9502-b68f1fbd8d4f', 'volume_name': 'volume-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee26866-99f2-40d2-9232-07e7fd3c4b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee26866-99f2-40d2-9232-07e7fd3c4b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f5566d-e464-4e07-96ac-888e10324d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:29 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Volume df1ca85d-0f20-40c9-9502-b68f1fbd8d4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f', 'volume_size': 1} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1899820286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1ca85d-0f20-40c9-9502-b68f1fbd8d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19dec55f19064ea7bd557357d03d2480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:29Z,use_quota=True,user_id='1bf555197e6f49e5bec7ca4fb3d6f154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Creating volume df1ca85d-0f20-40c9-9502-b68f1fbd8d4f {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:29 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:10:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:29 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f 1073741824 Sep 28 17:10:29 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:30 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f 1073741824" returned: 0 in 0.827s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:30 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f Sep 28 17:10:30 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:30 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f" returned: 0 in 0.421s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f5566d-e464-4e07-96ac-888e10324d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5663280-0f47-448f-a13c-1737190fd8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:30 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Volume volume-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f (df1ca85d-0f20-40c9-9502-b68f1fbd8d4f): created successfully Sep 28 17:10:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5663280-0f47-448f-a13c-1737190fd8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Flow 'volume_create_manager' (00c4becf-d32a-49f4-8748-ea98d1fba218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:30 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0eb8e6d8-a9b2-4c86-8832-a6c25947654f tempest-VolumesTransfersV357Test-504101305 None] Created volume successfully. Sep 28 17:10:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] Acquiring lock "cinder-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] Lock "cinder-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] Acquiring lock "cinder-quobyte-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] Lock "cinder-quobyte-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f" acquired by "delete_volume" :: waited 0.028s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:32 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36da934-e4de-4dbd-989c-3f40fe212966]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:32 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f Sep 28 17:10:32 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:32 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f" returned: 0 in 0.629s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:32 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f Sep 28 17:10:32 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:33 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f" returned: 0 in 0.460s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] Lock "cinder-quobyte-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f" released by "delete_volume" :: held 1.204s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:33 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] Created reservations ['176497f2-e7d1-489c-b835-b004bfee885c', '4bc97986-ddf7-4694-94f2-3fe1e14a452f', 'f24c9bde-b395-4433-a800-9150096beda8', '48a70314-5c3d-456f-a5c9-b50287365b42'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:33 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:10:33 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:33 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.416s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:33 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:33 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] Deleted volume successfully. Sep 28 17:10:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-813a6304-b381-459c-89da-f0781447431f tempest-VolumesTransfersV357Test-1229121522 None] Lock "cinder-df1ca85d-0f20-40c9-9502-b68f1fbd8d4f-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6fa34a88-08f7-49ec-ad84-a9919270204d tempest-VolumesActionsTest-2038700812 None] Acquiring lock "cinder-5767b3b3-3df4-4116-a98b-904f10320f46" by "attach_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6fa34a88-08f7-49ec-ad84-a9919270204d tempest-VolumesActionsTest-2038700812 None] Lock "cinder-5767b3b3-3df4-4116-a98b-904f10320f46" acquired by "attach_volume" :: waited 0.038s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:41 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-6fa34a88-08f7-49ec-ad84-a9919270204d tempest-VolumesActionsTest-2038700812 None] Attaching volume 5767b3b3-3df4-4116-a98b-904f10320f46 to instance abc4eb8f-6c26-4091-9ec1-a290cef2b809 at mountpoint /dev/vdb on host None. Sep 28 17:10:41 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-6fa34a88-08f7-49ec-ad84-a9919270204d tempest-VolumesActionsTest-2038700812 None] Attach volume completed successfully. Sep 28 17:10:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6fa34a88-08f7-49ec-ad84-a9919270204d tempest-VolumesActionsTest-2038700812 None] Lock "cinder-5767b3b3-3df4-4116-a98b-904f10320f46" released by "attach_volume" :: held 0.167s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-09d28d3c-7a64-4245-972e-3acb49024479 tempest-VolumesActionsTest-2038700812 None] Acquiring lock "cinder-5767b3b3-3df4-4116-a98b-904f10320f46-detach_volume" by "detach_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-09d28d3c-7a64-4245-972e-3acb49024479 tempest-VolumesActionsTest-2038700812 None] Lock "cinder-5767b3b3-3df4-4116-a98b-904f10320f46-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:42 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-09d28d3c-7a64-4245-972e-3acb49024479 tempest-VolumesActionsTest-2038700812 None] Detaching volume 5767b3b3-3df4-4116-a98b-904f10320f46 from instance abc4eb8f-6c26-4091-9ec1-a290cef2b809. Sep 28 17:10:42 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-09d28d3c-7a64-4245-972e-3acb49024479 tempest-VolumesActionsTest-2038700812 None] Detach volume completed successfully. Sep 28 17:10:42 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a9e0ee71-9a10-4a81-a6b2-d3848474c81a tempest-GroupsV314Test-521905119 None] Group tempest-GroupsV314Test-Group-1323437869: creating Sep 28 17:10:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-09d28d3c-7a64-4245-972e-3acb49024479 tempest-VolumesActionsTest-2038700812 None] Lock "cinder-5767b3b3-3df4-4116-a98b-904f10320f46-detach_volume" released by "detach_volume" :: held 0.244s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:42 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a9e0ee71-9a10-4a81-a6b2-d3848474c81a tempest-GroupsV314Test-521905119 None] Group tempest-GroupsV314Test-Group-1323437869: created successfully Sep 28 17:10:42 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a9e0ee71-9a10-4a81-a6b2-d3848474c81a tempest-GroupsV314Test-521905119 None] Create group completed successfully. Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Flow 'volume_create_manager' (a960519d-46dd-4b5c-953e-4cf6467a1107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f93004-fd75-4a14-b9e7-fff158d6d040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f93004-fd75-4a14-b9e7-fff158d6d040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1581223109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=697e5c2d-027f-4420-a928-b6b024a611fa,host='devstack@QuobyteHD#QuobyteHD',id=d791b1fd-35b0-46f0-8be9-58550c5c1894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c5fb6706d54031aee4d23aa933fff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:44Z,use_quota=True,user_id='fffe6ff373ce4ee8b3e9b221dfb9aff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7782b683-5451-44e0-b65e-6d222241a8de),volume_type_id=7782b683-5451-44e0-b65e-6d222241a8de)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e381fd-a1b3-43c9-aaae-8c402633a397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e381fd-a1b3-43c9-aaae-8c402633a397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ce7638-8b46-4c40-ab51-02e3f244cba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ce7638-8b46-4c40-ab51-02e3f244cba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd791b1fd-35b0-46f0-8be9-58550c5c1894', 'volume_name': 'volume-d791b1fd-35b0-46f0-8be9-58550c5c1894', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5609731-5912-493c-a075-721719fc6c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5609731-5912-493c-a075-721719fc6c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c609d0f-f087-4820-9a95-fd8e1c949e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:44 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Volume d791b1fd-35b0-46f0-8be9-58550c5c1894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d791b1fd-35b0-46f0-8be9-58550c5c1894', 'volume_size': 1} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=697e5c2d-027f-4420-a928-b6b024a611fa,created_at=2026-09-28T15:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1581223109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=697e5c2d-027f-4420-a928-b6b024a611fa,host='devstack@QuobyteHD#QuobyteHD',id=d791b1fd-35b0-46f0-8be9-58550c5c1894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5c5fb6706d54031aee4d23aa933fff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:44Z,use_quota=True,user_id='fffe6ff373ce4ee8b3e9b221dfb9aff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7782b683-5451-44e0-b65e-6d222241a8de),volume_type_id=7782b683-5451-44e0-b65e-6d222241a8de)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Creating volume d791b1fd-35b0-46f0-8be9-58550c5c1894 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:44 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:10:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:44 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 1073741824 Sep 28 17:10:44 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:45 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 1073741824" returned: 0 in 0.768s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:45 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 Sep 28 17:10:45 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:45 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894" returned: 0 in 0.445s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:45 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c609d0f-f087-4820-9a95-fd8e1c949e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d791b1fd-35b0-46f0-8be9-58550c5c1894', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928427df-dc78-428e-b02a-e661b20cffcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:45 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Volume volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 (d791b1fd-35b0-46f0-8be9-58550c5c1894): created successfully Sep 28 17:10:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928427df-dc78-428e-b02a-e661b20cffcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Flow 'volume_create_manager' (a960519d-46dd-4b5c-953e-4cf6467a1107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:45 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2d7cfcc9-281f-4bf8-988a-a41201f1012f tempest-GroupsV314Test-521905119 None] Created volume successfully. Sep 28 17:10:47 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:47 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Flow 'volume_create_manager' (5e1f002f-35cd-4289-ab77-7fe61314f751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:47 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6138376-b7f0-46ed-bc96-a9bf41c4431d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:47 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6138376-b7f0-46ed-bc96-a9bf41c4431d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2091811157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aef12c9-497e-4dd7-93a2-bf7eff2faa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc00da5652c41f78c95020988152b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:48Z,use_quota=True,user_id='3b750a6f74344e87a49e0639d6297fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:47 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138b470c-f9a7-426f-8fe1-53af2a552b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:47 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138b470c-f9a7-426f-8fe1-53af2a552b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:47 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5937ba0-bdfc-4cd9-9d55-6a5f61ff03c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:47 devstack cinder-volume[86970]: DEBUG cinder.image.glance [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Creating Keystone auth plugin from conf {{(pid=86970) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:10:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:48 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Cloning volume d791b1fd-35b0-46f0-8be9-58550c5c1894 to volume f9ee61d8-bf3e-4714-bcec-a51277f17326 Sep 28 17:10:48 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Creating offline snapshot 75d13093-d48a-42e0-80c3-28aa7cfcbe34 of volume d791b1fd-35b0-46f0-8be9-58550c5c1894 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:10:48 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e39aa9-8d24-4660-8b84-17eacf8e8481]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:48 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 Sep 28 17:10:48 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:48 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5937ba0-bdfc-4cd9-9d55-6a5f61ff03c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2aef12c9-497e-4dd7-93a2-bf7eff2faa63', 'volume_name': 'volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63', 'volume_size': 1, 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '280d624e0a3d44539d88968c5a0e8318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:48 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ce45ff-df09-45e8-b12d-ed543d03d63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:48 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ce45ff-df09-45e8-b12d-ed543d03d63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:48 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ad1049-6671-4608-af10-59c265d135b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:48 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Volume 2aef12c9-497e-4dd7-93a2-bf7eff2faa63: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63', 'volume_size': 1, 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '280d624e0a3d44539d88968c5a0e8318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:10:48 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Trying to clone 2aef12c9-497e-4dd7-93a2-bf7eff2faa63 from image d659fbbf-f540-415a-bb1b-8ef207a29f4e at location (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]). {{(pid=86970) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:10:48 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894" returned: 0 in 0.554s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:48 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34 1G Sep 28 17:10:48 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:49 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_bjrymhaudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:10:49 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:10:49 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9e967d-526c-439a-aca3-0868491f3909]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_bjrymhaudevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:49 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_bjrymhaudevstack@QuobyteHD Sep 28 17:10:49 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:49 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34 1G" returned: 0 in 0.841s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:49 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34 Sep 28 17:10:49 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:49 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_bjrymhaudevstack@QuobyteHD" returned: 0 in 0.512s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:49 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Temporary image d659fbbf-f540-415a-bb1b-8ef207a29f4e is fetched for user 3b750a6f74344e87a49e0639d6297fde. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:10:49 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5e5312-fabe-4ddc-b24b-be0adb529dd5]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_bjrymhaudevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:50 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34" returned: 0 in 0.607s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:50 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:10:50 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_bjrymhaudevstack@QuobyteHD Sep 28 17:10:50 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:50 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34 Sep 28 17:10:50 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:50 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_bjrymhaudevstack@QuobyteHD" returned: 0 in 0.535s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:50 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34" returned: 0 in 0.531s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:50 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.info Sep 28 17:10:50 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Flow 'volume_create_manager' (8e990905-775b-459e-8a3a-7c40fc16932d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc86a1e-6d44-4d97-b26d-c14515d5d9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc86a1e-6d44-4d97-b26d-c14515d5d9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1016244614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c83e48e-5d92-43a4-a970-af9c8f5ea54b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022c70e4863a48d69e20681785bd21e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:51Z,use_quota=True,user_id='56266a53e4484c838e8e4882eab2872d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda898de-f7fe-48e0-8751-a5632157bcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda898de-f7fe-48e0-8751-a5632157bcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe501de-90fe-47b1-a8ab-8e018fbcfbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe501de-90fe-47b1-a8ab-8e018fbcfbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c83e48e-5d92-43a4-a970-af9c8f5ea54b', 'volume_name': 'volume-9c83e48e-5d92-43a4-a970-af9c8f5ea54b', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b66fea09-0255-4fad-b802-33215948b8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b66fea09-0255-4fad-b802-33215948b8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0aa2fb6-7285-40d1-b8e0-0f72cb432597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:50 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Volume 9c83e48e-5d92-43a4-a970-af9c8f5ea54b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c83e48e-5d92-43a4-a970-af9c8f5ea54b', 'volume_size': 1} Sep 28 17:10:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:51 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.info" returned: 0 in 0.412s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:51 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:10:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:51 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.info Sep 28 17:10:51 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:51 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.info" returned: 0 in 0.330s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:51 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Acquiring lock "cinder-quobyte-f9ee61d8-bf3e-4714-bcec-a51277f17326" by "_copy_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:51 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Lock "cinder-quobyte-f9ee61d8-bf3e-4714-bcec-a51277f17326" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] snapshot: 75d13093-d48a-42e0-80c3-28aa7cfcbe34, volume: f9ee61d8-bf3e-4714-bcec-a51277f17326, {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:10:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:51 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d33cb7-491f-4529-8371-8d55c36c6436]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:51 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34 Sep 28 17:10:51 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:52 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34" returned: 0 in 0.554s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d791b1fd-35b0-46f0-8be9-58550c5c1894(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:10:52 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d87c61-420f-4c9a-9853-5928a9b34887]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:52 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 Sep 28 17:10:52 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:52 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894" returned: 0 in 0.498s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:10:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Creating direct copy from snapshot {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:10:52 devstack cinder-volume[86970]: DEBUG cinder.utils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Path /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9ee61d8-bf3e-4714-bcec-a51277f17326 not found in is_blk_device check {{(pid=86970) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:10:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9ee61d8-bf3e-4714-bcec-a51277f17326 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:52 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9ee61d8-bf3e-4714-bcec-a51277f17326 Sep 28 17:10:52 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:00 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=97,cinder:INSERT=23,cinder:UPDATE=96,cinder:DELETE=13 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:11:00 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:UPDATE=113,cinder:SELECT=90,cinder:INSERT=29,cinder:DELETE=2 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:11:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:11:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0fc7b079-c71c-4005-ab2c-6f0bdad18f78 tempest-VolumesActionsTest-2038700812 None] Acquiring lock "cinder-5767b3b3-3df4-4116-a98b-904f10320f46" by "attach_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0fc7b079-c71c-4005-ab2c-6f0bdad18f78 tempest-VolumesActionsTest-2038700812 None] Lock "cinder-5767b3b3-3df4-4116-a98b-904f10320f46" acquired by "attach_volume" :: waited 0.053s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:01 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:11:01 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:01 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0fc7b079-c71c-4005-ab2c-6f0bdad18f78 tempest-VolumesActionsTest-2038700812 None] Attaching volume 5767b3b3-3df4-4116-a98b-904f10320f46 to instance 6962e27b-aa42-4ac3-afa4-cbd4a1e2f64b at mountpoint /dev/vdb on host None. Sep 28 17:11:01 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0fc7b079-c71c-4005-ab2c-6f0bdad18f78 tempest-VolumesActionsTest-2038700812 None] Attach volume completed successfully. Sep 28 17:11:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0fc7b079-c71c-4005-ab2c-6f0bdad18f78 tempest-VolumesActionsTest-2038700812 None] Lock "cinder-5767b3b3-3df4-4116-a98b-904f10320f46" released by "attach_volume" :: held 0.347s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:02 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 1.025s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:02 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:02 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:11:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:11:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:11:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-84188e22-5b6c-47a4-93d7-3e4f755ff3ee tempest-VolumesActionsTest-2038700812 None] Acquiring lock "cinder-5767b3b3-3df4-4116-a98b-904f10320f46-detach_volume" by "detach_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-84188e22-5b6c-47a4-93d7-3e4f755ff3ee tempest-VolumesActionsTest-2038700812 None] Lock "cinder-5767b3b3-3df4-4116-a98b-904f10320f46-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:02 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-84188e22-5b6c-47a4-93d7-3e4f755ff3ee tempest-VolumesActionsTest-2038700812 None] Detaching volume 5767b3b3-3df4-4116-a98b-904f10320f46 from instance 6962e27b-aa42-4ac3-afa4-cbd4a1e2f64b. Sep 28 17:11:02 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-84188e22-5b6c-47a4-93d7-3e4f755ff3ee tempest-VolumesActionsTest-2038700812 None] Detach volume completed successfully. Sep 28 17:11:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-84188e22-5b6c-47a4-93d7-3e4f755ff3ee tempest-VolumesActionsTest-2038700812 None] Lock "cinder-5767b3b3-3df4-4116-a98b-904f10320f46-detach_volume" released by "detach_volume" :: held 0.163s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9ee61d8-bf3e-4714-bcec-a51277f17326" returned: 0 in 10.920s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:03 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Image conversion details: src /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894, size 1024.00 MB, duration 10.92 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9ee61d8-bf3e-4714-bcec-a51277f17326 {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:11:03 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Converted 1024.00 MB image at 93.76 MB/s Sep 28 17:11:03 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9ee61d8-bf3e-4714-bcec-a51277f17326 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:11:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9ee61d8-bf3e-4714-bcec-a51277f17326 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:03 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9ee61d8-bf3e-4714-bcec-a51277f17326 Sep 28 17:11:03 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:04 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9ee61d8-bf3e-4714-bcec-a51277f17326" returned: 0 in 0.449s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Lock "cinder-quobyte-f9ee61d8-bf3e-4714-bcec-a51277f17326" released by "_copy_volume_from_snapshot" :: held 12.544s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Acquiring lock "cinder-quobyte-75d13093-d48a-42e0-80c3-28aa7cfcbe34" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Lock "cinder-quobyte-75d13093-d48a-42e0-80c3-28aa7cfcbe34" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Deleting offline snapshot 75d13093-d48a-42e0-80c3-28aa7cfcbe34 of volume d791b1fd-35b0-46f0-8be9-58550c5c1894 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:11:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] snapshot_file for this snap is: volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:11:04 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[030ac6e1-3b4f-4aac-ba1e-971156437bd9]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:04 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34 Sep 28 17:11:04 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:04 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34" returned: 0 in 0.562s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d791b1fd-35b0-46f0-8be9-58550c5c1894(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:11:04 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[56aaed28-1d3d-4a3a-8840-89b9b8fd2c79]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:05 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 Sep 28 17:11:05 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:05 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894" returned: 0 in 0.788s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:05 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34 Sep 28 17:11:05 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:06 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34" returned: 0 in 0.431s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:06 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34 Sep 28 17:11:06 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:06 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894.75d13093-d48a-42e0-80c3-28aa7cfcbe34" returned: 0 in 0.309s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Lock "cinder-quobyte-75d13093-d48a-42e0-80c3-28aa7cfcbe34" released by "_delete_snapshot" :: held 2.257s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.428s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.960s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2091811157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aef12c9-497e-4dd7-93a2-bf7eff2faa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc00da5652c41f78c95020988152b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:48Z,use_quota=True,user_id='3b750a6f74344e87a49e0639d6297fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Creating volume 2aef12c9-497e-4dd7-93a2-bf7eff2faa63 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:06 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:11:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:06 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 1073741824 Sep 28 17:11:06 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:06 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3f7372cf-f0a1-49a9-a2a4-6c48581c09c5 tempest-GroupsV314Test-521905119 None] Create group from source-group-697e5c2d-027f-4420-a928-b6b024a611fa completed successfully. Sep 28 17:11:07 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 1073741824" returned: 0 in 0.638s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:07 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 Sep 28 17:11:07 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] Acquiring lock "cinder-quobyte-f9ee61d8-bf3e-4714-bcec-a51277f17326" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] Lock "cinder-quobyte-f9ee61d8-bf3e-4714-bcec-a51277f17326" acquired by "delete_volume" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e373a9-2708-48d5-814c-624c2fc11ab0]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9ee61d8-bf3e-4714-bcec-a51277f17326 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:07 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63" returned: 0 in 0.310s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.576s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1016244614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c83e48e-5d92-43a4-a970-af9c8f5ea54b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022c70e4863a48d69e20681785bd21e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:51Z,use_quota=True,user_id='56266a53e4484c838e8e4882eab2872d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Creating volume 9c83e48e-5d92-43a4-a970-af9c8f5ea54b {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:07 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c83e48e-5d92-43a4-a970-af9c8f5ea54b 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:07 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9ee61d8-bf3e-4714-bcec-a51277f17326 Sep 28 17:11:07 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:07 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c83e48e-5d92-43a4-a970-af9c8f5ea54b 1073741824 Sep 28 17:11:07 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Attempting download of d659fbbf-f540-415a-bb1b-8ef207a29f4e ((None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}])) to volume 2aef12c9-497e-4dd7-93a2-bf7eff2faa63. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b86058-96e1-4b15-978b-20c194bbcbe9]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_wkinhcf6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:07 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_wkinhcf6 Sep 28 17:11:07 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:07 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9ee61d8-bf3e-4714-bcec-a51277f17326" returned: 0 in 0.525s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9ee61d8-bf3e-4714-bcec-a51277f17326 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:07 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9ee61d8-bf3e-4714-bcec-a51277f17326 Sep 28 17:11:07 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:08 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_wkinhcf6" returned: 0 in 0.499s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_wkinhcf6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:08 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c83e48e-5d92-43a4-a970-af9c8f5ea54b 1073741824" returned: 0 in 0.717s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:08 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9ee61d8-bf3e-4714-bcec-a51277f17326" returned: 0 in 0.368s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c83e48e-5d92-43a4-a970-af9c8f5ea54b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:08 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_wkinhcf6 Sep 28 17:11:08 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] Lock "cinder-quobyte-f9ee61d8-bf3e-4714-bcec-a51277f17326" released by "delete_volume" :: held 0.960s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:08 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c83e48e-5d92-43a4-a970-af9c8f5ea54b Sep 28 17:11:08 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] Created reservations ['88f69023-45f9-4ae8-87de-bdbba2ad3f9a'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:08 devstack cinder-volume[86970]: WARNING cinder.quota [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1422495120 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1422495120, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:11:08 devstack cinder-volume[86970]: WARNING cinder.quota [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1422495120 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1422495120, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] Created reservations ['20e34ad5-f2b2-4527-a5ee-8dfa4f4a9a5e', '0ff36ddb-c8e6-4a3f-bf75-b0c9e4c5e378', 'fbe0589e-d415-4ec9-98d0-888190581021', 'd62c7edc-ee9f-4f8f-b527-fe7ffd02cb83'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:08 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_wkinhcf6" returned: 1 in 0.457s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_wkinhcf6' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58b7fac-70d8-4f34-99de-6b3d07115b5e]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_bjrymhaudevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:08 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c83e48e-5d92-43a4-a970-af9c8f5ea54b" returned: 0 in 0.422s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:08 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:11:08 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0aa2fb6-7285-40d1-b8e0-0f72cb432597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c83e48e-5d92-43a4-a970-af9c8f5ea54b', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced85106-3a95-4914-b047-9579ba2bdad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:08 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Volume volume-9c83e48e-5d92-43a4-a970-af9c8f5ea54b (9c83e48e-5d92-43a4-a970-af9c8f5ea54b): created successfully Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced85106-3a95-4914-b047-9579ba2bdad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Flow 'volume_create_manager' (8e990905-775b-459e-8a3a-7c40fc16932d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:08 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_bjrymhaudevstack@QuobyteHD Sep 28 17:11:08 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:08 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-7cceda6c-ff1a-4c8a-b5ba-7538649557b6 tempest-VolumesListAdminTestJSON-1092207319 None] Created volume successfully. Sep 28 17:11:09 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.480s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:09 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-aafcea55-b38e-4467-ada5-4953e0266fce tempest-GroupsV314Test-521905119 None] Delete group completed successfully. Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d7c4bfee-9f4f-409e-a0aa-8cdbd338bd9a tempest-VolumesActionsTest-2038700812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d7c4bfee-9f4f-409e-a0aa-8cdbd338bd9a tempest-VolumesActionsTest-2038700812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:09 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_bjrymhaudevstack@QuobyteHD" returned: 0 in 0.598s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] d659fbbf-f540-415a-bb1b-8ef207a29f4e was qcow2, converting to qcow2 {{(pid=86970) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_bjrymhaudevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf09bb8-0ad2-4f39-9c6d-609135991f0c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d7c4bfee-9f4f-409e-a0aa-8cdbd338bd9a tempest-VolumesActionsTest-2038700812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:09 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_bjrymhaudevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 Sep 28 17:11:09 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] Acquiring lock "cinder-quobyte-d791b1fd-35b0-46f0-8be9-58550c5c1894" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:09 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 Sep 28 17:11:09 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] Lock "cinder-quobyte-d791b1fd-35b0-46f0-8be9-58550c5c1894" acquired by "delete_volume" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c5e782-7a34-4da0-bddd-dffa01eba719]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:09 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 Sep 28 17:11:09 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:09 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d7c4bfee-9f4f-409e-a0aa-8cdbd338bd9a tempest-VolumesActionsTest-2038700812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46" returned: 0 in 0.500s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dccd3b-219a-472e-9816-be408a32c902]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d7c4bfee-9f4f-409e-a0aa-8cdbd338bd9a tempest-VolumesActionsTest-2038700812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:09 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 Sep 28 17:11:09 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:09 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894" returned: 0 in 0.487s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:09 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894 Sep 28 17:11:09 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:10 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d7c4bfee-9f4f-409e-a0aa-8cdbd338bd9a tempest-VolumesActionsTest-2038700812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46" returned: 0 in 0.485s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d7c4bfee-9f4f-409e-a0aa-8cdbd338bd9a tempest-VolumesActionsTest-2038700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.ed3dcd72-dc19-4ab1-99de-a4ed1d05b4d4vfvbzio3.img {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:10 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.ed3dcd72-dc19-4ab1-99de-a4ed1d05b4d4vfvbzio3.img Sep 28 17:11:10 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:10 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d791b1fd-35b0-46f0-8be9-58550c5c1894" returned: 0 in 0.494s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] Lock "cinder-quobyte-d791b1fd-35b0-46f0-8be9-58550c5c1894" released by "delete_volume" :: held 1.070s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:10 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] Created reservations ['17ade741-6502-4d26-84fe-fceacfb3a8dc'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:10 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] Created reservations ['b6629c10-f029-4f44-a987-2b185272a13e', '22fd64a8-3b78-44c3-81c3-19fb82d5f44b', 'c897761d-01e0-4f8f-94e4-09410b8997e4', 'fbadfb22-290f-434d-8541-d95e758a573b'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:10 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Flow 'volume_create_manager' (2cf09adf-bcbd-40dd-99dd-2aa1a3d3b15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2820539-7e87-41e4-b6a0-915d8953503b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:11 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:11:11 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2820539-7e87-41e4-b6a0-915d8953503b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1826923674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4310cb-776b-48c4-8afe-63bfcd6413f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022c70e4863a48d69e20681785bd21e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:11Z,use_quota=True,user_id='56266a53e4484c838e8e4882eab2872d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb15b7d5-3add-4166-8405-8868b6aa51c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb15b7d5-3add-4166-8405-8868b6aa51c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2feb245-007f-4d8d-a3f3-1285d9a78c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2feb245-007f-4d8d-a3f3-1285d9a78c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d4310cb-776b-48c4-8afe-63bfcd6413f5', 'volume_name': 'volume-8d4310cb-776b-48c4-8afe-63bfcd6413f5', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389ad4e2-d375-44d3-924d-5da5f540f358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389ad4e2-d375-44d3-924d-5da5f540f358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61653b61-1283-4447-930a-73d48aaf730f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:11 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Volume 8d4310cb-776b-48c4-8afe-63bfcd6413f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d4310cb-776b-48c4-8afe-63bfcd6413f5', 'volume_size': 1} Sep 28 17:11:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:11 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.621s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:11 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:11 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-535688e5-626f-42cd-8d22-a995e0b8f4f7 tempest-GroupsV314Test-521905119 None] Delete group completed successfully. Sep 28 17:11:13 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_bjrymhaudevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63" returned: 0 in 4.041s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:13 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_bjrymhaudevstack@QuobyteHD, size 112.00 MB, duration 4.04 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:11:13 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Converted 112.00 MB image at 27.69 MB/s Sep 28 17:11:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:13 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 1G Sep 28 17:11:13 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:14 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 1G" returned: 0 in 0.754s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:14 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Downloaded image d659fbbf-f540-415a-bb1b-8ef207a29f4e ((None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}])) to volume 2aef12c9-497e-4dd7-93a2-bf7eff2faa63 successfully. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:11:14 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Temporary image d659fbbf-f540-415a-bb1b-8ef207a29f4e for user 3b750a6f74344e87a49e0639d6297fde is deleted. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:11:14 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Marking volume 2aef12c9-497e-4dd7-93a2-bf7eff2faa63 as bootable. {{(pid=86970) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:11:14 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Copying metadata from image d659fbbf-f540-415a-bb1b-8ef207a29f4e to 2aef12c9-497e-4dd7-93a2-bf7eff2faa63. {{(pid=86970) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:11:14 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Creating volume glance metadata for volume 2aef12c9-497e-4dd7-93a2-bf7eff2faa63 backed by image d659fbbf-f540-415a-bb1b-8ef207a29f4e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86970) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:11:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ad1049-6671-4608-af10-59c265d135b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63', 'volume_size': 1, 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '280d624e0a3d44539d88968c5a0e8318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa22017c-0239-434c-92c6-8970b9004940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:14 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Volume volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 (2aef12c9-497e-4dd7-93a2-bf7eff2faa63): created successfully Sep 28 17:11:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa22017c-0239-434c-92c6-8970b9004940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Flow 'volume_create_manager' (5e1f002f-35cd-4289-ab77-7fe61314f751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:14 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-98be7485-f950-43bc-8685-dc73a3720074 tempest-VolumesExtendTest-1380153603 None] Created volume successfully. Sep 28 17:11:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a295fc43-f467-4c06-accd-535c7298552a tempest-VolumesExtendTest-1380153603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:18 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d7c4bfee-9f4f-409e-a0aa-8cdbd338bd9a tempest-VolumesActionsTest-2038700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.ed3dcd72-dc19-4ab1-99de-a4ed1d05b4d4vfvbzio3.img" returned: 0 in 8.077s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:18 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a99cdae-e23d-42bf-95d5-54184723c12f]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d7c4bfee-9f4f-409e-a0aa-8cdbd338bd9a tempest-VolumesActionsTest-2038700812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:18 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 Sep 28 17:11:18 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:19 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d7c4bfee-9f4f-409e-a0aa-8cdbd338bd9a tempest-VolumesActionsTest-2038700812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46" returned: 0 in 0.680s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:19 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-d7c4bfee-9f4f-409e-a0aa-8cdbd338bd9a tempest-VolumesActionsTest-2038700812 None] Image conversion details: src /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46, size 1024.00 MB, duration 8.08 sec, destination /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.ed3dcd72-dc19-4ab1-99de-a4ed1d05b4d4vfvbzio3.img {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:11:19 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-d7c4bfee-9f4f-409e-a0aa-8cdbd338bd9a tempest-VolumesActionsTest-2038700812 None] Converted 1024.00 MB image at 126.76 MB/s Sep 28 17:11:19 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-d7c4bfee-9f4f-409e-a0aa-8cdbd338bd9a tempest-VolumesActionsTest-2038700812 None] ed3dcd72-dc19-4ab1-99de-a4ed1d05b4d4 was raw, no need to convert to raw {{(pid=86970) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 17:11:22 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Flow 'volume_create_manager' (f40fcd51-08cd-4e27-aaf5-213f5222f2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bff926c-ed4f-49a5-9ba2-e63b03ea9dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bff926c-ed4f-49a5-9ba2-e63b03ea9dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-699198375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee9c618-b0f9-4753-b403-56d97b78b92c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b2305fc4984490bbc60d91ca475261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:23Z,use_quota=True,user_id='f5c9ade084f54859ac13f1f6b5533b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1c2dac1-1d29-432c-9464-43045ab62fde),volume_type_id=b1c2dac1-1d29-432c-9464-43045ab62fde)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e7db66-8c09-45aa-9581-819eae0a6354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e7db66-8c09-45aa-9581-819eae0a6354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db20b3f-c48f-4d16-a01c-bb7ec61d74ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db20b3f-c48f-4d16-a01c-bb7ec61d74ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cee9c618-b0f9-4753-b403-56d97b78b92c', 'volume_name': 'volume-cee9c618-b0f9-4753-b403-56d97b78b92c', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52beebab-8d98-4925-866b-5575de6a35a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52beebab-8d98-4925-866b-5575de6a35a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2abd6f-08f8-451a-93da-a0fc7715244a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:22 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Volume cee9c618-b0f9-4753-b403-56d97b78b92c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cee9c618-b0f9-4753-b403-56d97b78b92c', 'volume_size': 1} Sep 28 17:11:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:32 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=33,cinder:UPDATE=35,cinder:INSERT=12,cinder:DELETE=2 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:11:32 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=40,cinder:INSERT=14,cinder:UPDATE=35 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:11:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d7c4bfee-9f4f-409e-a0aa-8cdbd338bd9a tempest-VolumesActionsTest-2038700812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.948s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d7c4bfee-9f4f-409e-a0aa-8cdbd338bd9a tempest-VolumesActionsTest-2038700812 None] Uploaded volume to glance image-id: ed3dcd72-dc19-4ab1-99de-a4ed1d05b4d4. {{(pid=86970) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:11:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.937s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1826923674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4310cb-776b-48c4-8afe-63bfcd6413f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022c70e4863a48d69e20681785bd21e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:11Z,use_quota=True,user_id='56266a53e4484c838e8e4882eab2872d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Creating volume 8d4310cb-776b-48c4-8afe-63bfcd6413f5 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:39 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:11:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d4310cb-776b-48c4-8afe-63bfcd6413f5 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:39 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d4310cb-776b-48c4-8afe-63bfcd6413f5 1073741824 Sep 28 17:11:39 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:39 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d7c4bfee-9f4f-409e-a0aa-8cdbd338bd9a tempest-VolumesActionsTest-2038700812 None] Copy volume to image completed successfully. Sep 28 17:11:39 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d4310cb-776b-48c4-8afe-63bfcd6413f5 1073741824" returned: 0 in 0.574s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d4310cb-776b-48c4-8afe-63bfcd6413f5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:39 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d4310cb-776b-48c4-8afe-63bfcd6413f5 Sep 28 17:11:39 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:40 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d4310cb-776b-48c4-8afe-63bfcd6413f5" returned: 0 in 0.342s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a295fc43-f467-4c06-accd-535c7298552a tempest-VolumesExtendTest-1380153603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 25.203s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61653b61-1283-4447-930a-73d48aaf730f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d4310cb-776b-48c4-8afe-63bfcd6413f5', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4534ecef-31a3-4212-802c-20e22d5d9364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd78880-a584-4cc6-bef1-7c435e2348e7]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a295fc43-f467-4c06-accd-535c7298552a tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:40 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Volume volume-8d4310cb-776b-48c4-8afe-63bfcd6413f5 (8d4310cb-776b-48c4-8afe-63bfcd6413f5): created successfully Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4534ecef-31a3-4212-802c-20e22d5d9364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Flow 'volume_create_manager' (2cf09adf-bcbd-40dd-99dd-2aa1a3d3b15b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:40 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-321f87b7-3bad-4749-988f-7dbedff0e8d6 tempest-VolumesListAdminTestJSON-1092207319 None] Created volume successfully. Sep 28 17:11:40 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 Sep 28 17:11:40 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:40 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a295fc43-f467-4c06-accd-535c7298552a tempest-VolumesExtendTest-1380153603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63" returned: 0 in 0.482s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a295fc43-f467-4c06-accd-535c7298552a tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 2G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a295fc43-f467-4c06-accd-535c7298552a tempest-VolumesExtendTest-1380153603 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 2G" returned: 0 in 0.173s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a295fc43-f467-4c06-accd-535c7298552a tempest-VolumesExtendTest-1380153603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.690s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.974s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-699198375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee9c618-b0f9-4753-b403-56d97b78b92c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b2305fc4984490bbc60d91ca475261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:23Z,use_quota=True,user_id='f5c9ade084f54859ac13f1f6b5533b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1c2dac1-1d29-432c-9464-43045ab62fde),volume_type_id=b1c2dac1-1d29-432c-9464-43045ab62fde)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Creating volume cee9c618-b0f9-4753-b403-56d97b78b92c {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:40 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:11:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cee9c618-b0f9-4753-b403-56d97b78b92c 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:40 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cee9c618-b0f9-4753-b403-56d97b78b92c 1073741824 Sep 28 17:11:40 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:40 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a295fc43-f467-4c06-accd-535c7298552a tempest-VolumesExtendTest-1380153603 None] Extend volume completed successfully. Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Flow 'volume_create_manager' (17a16633-f36e-4d83-9114-6f21f7d5e5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5135ea93-8855-4505-9cf1-7fae1c2f7ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5135ea93-8855-4505-9cf1-7fae1c2f7ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-116748676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9573951b-3da2-427d-919f-e0ae0cc0b40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022c70e4863a48d69e20681785bd21e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:41Z,use_quota=True,user_id='56266a53e4484c838e8e4882eab2872d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b879313f-532e-471b-bf8a-a9f2c95f0be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b879313f-532e-471b-bf8a-a9f2c95f0be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66349cec-ee3b-4e65-9ecd-cf25f16ec817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66349cec-ee3b-4e65-9ecd-cf25f16ec817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9573951b-3da2-427d-919f-e0ae0cc0b40b', 'volume_name': 'volume-9573951b-3da2-427d-919f-e0ae0cc0b40b', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc88145-41d0-442f-a4c8-3bfc79eef7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc88145-41d0-442f-a4c8-3bfc79eef7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c44f8f9-bbd2-47ad-97a4-a419641cf276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:41 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Volume 9573951b-3da2-427d-919f-e0ae0cc0b40b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9573951b-3da2-427d-919f-e0ae0cc0b40b', 'volume_size': 1} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:41 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cee9c618-b0f9-4753-b403-56d97b78b92c 1073741824" returned: 0 in 0.663s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cee9c618-b0f9-4753-b403-56d97b78b92c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:41 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cee9c618-b0f9-4753-b403-56d97b78b92c Sep 28 17:11:41 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] Acquiring lock "cinder-2aef12c9-497e-4dd7-93a2-bf7eff2faa63-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] Lock "cinder-2aef12c9-497e-4dd7-93a2-bf7eff2faa63-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] Acquiring lock "cinder-quobyte-2aef12c9-497e-4dd7-93a2-bf7eff2faa63" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] Lock "cinder-quobyte-2aef12c9-497e-4dd7-93a2-bf7eff2faa63" acquired by "delete_volume" :: waited 0.017s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a088e87-b84a-475b-ba21-66e311fb3e50]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:41 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cee9c618-b0f9-4753-b403-56d97b78b92c" returned: 0 in 0.307s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.069s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2abd6f-08f8-451a-93da-a0fc7715244a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cee9c618-b0f9-4753-b403-56d97b78b92c', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c084ceb0-e238-4326-b2c6-10f9d12f7416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8fd2b7-0ee3-4c63-9c9e-35218d881d04]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:41 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Volume volume-cee9c618-b0f9-4753-b403-56d97b78b92c (cee9c618-b0f9-4753-b403-56d97b78b92c): created successfully Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c084ceb0-e238-4326-b2c6-10f9d12f7416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Flow 'volume_create_manager' (f40fcd51-08cd-4e27-aaf5-213f5222f2d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:41 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 Sep 28 17:11:41 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:41 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-13f0dfe7-d833-4a6e-bf04-be612b7151ed tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Created volume successfully. Sep 28 17:11:41 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 Sep 28 17:11:41 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:42 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63" returned: 0 in 0.480s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:42 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63 Sep 28 17:11:42 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:42 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46" returned: 0 in 0.515s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2843d8-223a-475c-b83b-43a67c47a320]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:42 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2aef12c9-497e-4dd7-93a2-bf7eff2faa63" returned: 0 in 0.310s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:42 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 Sep 28 17:11:42 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] Lock "cinder-quobyte-2aef12c9-497e-4dd7-93a2-bf7eff2faa63" released by "delete_volume" :: held 0.845s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] Created reservations ['877fe44b-0565-4c41-818e-b7297b10190d', '240b09d4-e1dc-4623-8dc3-266530217577', '10915750-1712-40f5-8a55-4c78ed74c068', '01dfdada-1ca0-440e-aaf7-345cd053fdc6'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3c818cf5-ca61-4e82-a505-1b71555314f3 tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3c818cf5-ca61-4e82-a505-1b71555314f3 tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3c818cf5-ca61-4e82-a505-1b71555314f3 tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3c818cf5-ca61-4e82-a505-1b71555314f3 tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3c818cf5-ca61-4e82-a505-1b71555314f3 tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3c818cf5-ca61-4e82-a505-1b71555314f3 tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:42 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:11:42 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:42 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:11:42 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:42 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46" returned: 0 in 0.519s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.43ae9b86-52f9-47c1-9cb2-692fd8485f86m2ynw4yh.img {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:42 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.43ae9b86-52f9-47c1-9cb2-692fd8485f86m2ynw4yh.img Sep 28 17:11:42 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:43 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3c818cf5-ca61-4e82-a505-1b71555314f3 tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.369s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:43 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-3c818cf5-ca61-4e82-a505-1b71555314f3 tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:43 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3c818cf5-ca61-4e82-a505-1b71555314f3 tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Retype volume completed successfully. Sep 28 17:11:43 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.351s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:43 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:43 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] Deleted volume successfully. Sep 28 17:11:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33be7d09-fa16-4e8b-8d5d-40ff3155e249 tempest-VolumesExtendTest-1380153603 None] Lock "cinder-2aef12c9-497e-4dd7-93a2-bf7eff2faa63-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:43 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:43 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Flow 'volume_create_manager' (404b05df-877b-42af-b050-d6b673286eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:43 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62083e3-ae21-44a9-b7c7-545c0adf5d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62083e3-ae21-44a9-b7c7-545c0adf5d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-51657835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea0ebab-f168-4270-b7b8-b27be654239c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc00da5652c41f78c95020988152b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:44Z,use_quota=True,user_id='3b750a6f74344e87a49e0639d6297fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5eafd8-00af-4d9d-a3b0-acfda120bb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5eafd8-00af-4d9d-a3b0-acfda120bb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319a1f75-8b62-441e-93f1-8c402f472be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319a1f75-8b62-441e-93f1-8c402f472be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea0ebab-f168-4270-b7b8-b27be654239c', 'volume_name': 'volume-eea0ebab-f168-4270-b7b8-b27be654239c', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455a91df-50bf-45ca-afdf-d585d3fc72a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455a91df-50bf-45ca-afdf-d585d3fc72a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:44 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49a059c-cadb-45a1-b2b6-5cda1a2a5bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:44 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Volume eea0ebab-f168-4270-b7b8-b27be654239c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea0ebab-f168-4270-b7b8-b27be654239c', 'volume_size': 1} Sep 28 17:11:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:44 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Acquiring lock "cinder-cee9c618-b0f9-4753-b403-56d97b78b92c-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:44 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Lock "cinder-cee9c618-b0f9-4753-b403-56d97b78b92c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:44 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Acquiring lock "cinder-quobyte-cee9c618-b0f9-4753-b403-56d97b78b92c" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:44 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Lock "cinder-quobyte-cee9c618-b0f9-4753-b403-56d97b78b92c" acquired by "delete_volume" :: waited 0.045s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:44 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c1c5a0-3ae4-400c-bd23-7e097dbb85fd]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cee9c618-b0f9-4753-b403-56d97b78b92c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:44 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cee9c618-b0f9-4753-b403-56d97b78b92c Sep 28 17:11:44 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:45 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cee9c618-b0f9-4753-b403-56d97b78b92c" returned: 0 in 0.738s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cee9c618-b0f9-4753-b403-56d97b78b92c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:45 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cee9c618-b0f9-4753-b403-56d97b78b92c Sep 28 17:11:45 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:45 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cee9c618-b0f9-4753-b403-56d97b78b92c" returned: 0 in 0.571s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Lock "cinder-quobyte-cee9c618-b0f9-4753-b403-56d97b78b92c" released by "delete_volume" :: held 1.414s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:46 devstack cinder-volume[86970]: WARNING cinder.quota [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:11:46 devstack cinder-volume[86970]: WARNING cinder.quota [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:11:46 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Created reservations ['9565f6f7-e5a6-4ce7-afe8-9a570258a9e1', '6c6c172b-0a78-4af0-b9e4-6a478bc2d9f6', 'bb9a60fd-7ae4-4c23-9c48-f019ca6fc58f', '502177cb-e8cd-4ea3-84d3-4ee279d3e8e8'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:46 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:46 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:46 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:11:46 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:46 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.517s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:46 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:46 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Deleted volume successfully. Sep 28 17:11:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ad0bf53c-5acb-4c58-b64e-210c7efb3abc tempest-VolumeRetypeWithoutMigrationTest-1514909758 None] Lock "cinder-cee9c618-b0f9-4753-b403-56d97b78b92c-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:50 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.43ae9b86-52f9-47c1-9cb2-692fd8485f86m2ynw4yh.img" returned: 0 in 7.651s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:50 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87266b8-88c4-4942-b348-800bfc118ddf]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:50 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 Sep 28 17:11:50 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:51 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46" returned: 0 in 0.675s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:51 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] Image conversion details: src /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46, size 1024.00 MB, duration 7.65 sec, destination /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.43ae9b86-52f9-47c1-9cb2-692fd8485f86m2ynw4yh.img {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:11:51 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] Converted 1024.00 MB image at 133.82 MB/s Sep 28 17:11:51 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] 43ae9b86-52f9-47c1-9cb2-692fd8485f86 was raw, converting to qcow2 {{(pid=86970) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 17:11:51 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af67daf-00ac-409b-8f3b-1a9b0c3a341f]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.43ae9b86-52f9-47c1-9cb2-692fd8485f86m2ynw4yh.img {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:51 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.43ae9b86-52f9-47c1-9cb2-692fd8485f86m2ynw4yh.img Sep 28 17:11:51 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:51 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.43ae9b86-52f9-47c1-9cb2-692fd8485f86m2ynw4yh.img" returned: 0 in 0.368s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.43ae9b86-52f9-47c1-9cb2-692fd8485f86m2ynw4yh.img {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:51 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.43ae9b86-52f9-47c1-9cb2-692fd8485f86m2ynw4yh.img Sep 28 17:11:51 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:52 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.43ae9b86-52f9-47c1-9cb2-692fd8485f86m2ynw4yh.img" returned: 1 in 0.441s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.43ae9b86-52f9-47c1-9cb2-692fd8485f86m2ynw4yh.img' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:11:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.43ae9b86-52f9-47c1-9cb2-692fd8485f86m2ynw4yh.img /opt/stack/data/cinder/conversion/vol_upload_dk32xvl8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:52 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.43ae9b86-52f9-47c1-9cb2-692fd8485f86m2ynw4yh.img /opt/stack/data/cinder/conversion/vol_upload_dk32xvl8 Sep 28 17:11:52 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:52 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.43ae9b86-52f9-47c1-9cb2-692fd8485f86m2ynw4yh.img /opt/stack/data/cinder/conversion/vol_upload_dk32xvl8" returned: 0 in 0.322s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:52 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] Image conversion details: src /opt/stack/data/cinder/conversion/5767b3b3-3df4-4116-a98b-904f10320f46.temp_image.43ae9b86-52f9-47c1-9cb2-692fd8485f86m2ynw4yh.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_dk32xvl8 {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:11:52 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 17:11:52 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[03638da4-fec1-4410-a06e-250fdf5348a0]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dk32xvl8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:52 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dk32xvl8 Sep 28 17:11:52 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:52 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dk32xvl8" returned: 0 in 0.438s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.812s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] Uploaded volume to glance image-id: 43ae9b86-52f9-47c1-9cb2-692fd8485f86. {{(pid=86970) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:11:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.347s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-116748676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9573951b-3da2-427d-919f-e0ae0cc0b40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022c70e4863a48d69e20681785bd21e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:41Z,use_quota=True,user_id='56266a53e4484c838e8e4882eab2872d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Creating volume 9573951b-3da2-427d-919f-e0ae0cc0b40b {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:54 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:11:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9573951b-3da2-427d-919f-e0ae0cc0b40b 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:54 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1e279650-0ca1-46f5-9a98-71bfab7c8cd1 tempest-VolumesActionsTest-2038700812 None] Copy volume to image completed successfully. Sep 28 17:11:54 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9573951b-3da2-427d-919f-e0ae0cc0b40b 1073741824 Sep 28 17:11:54 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:55 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9573951b-3da2-427d-919f-e0ae0cc0b40b 1073741824" returned: 0 in 0.595s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9573951b-3da2-427d-919f-e0ae0cc0b40b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:55 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9573951b-3da2-427d-919f-e0ae0cc0b40b Sep 28 17:11:55 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:55 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9573951b-3da2-427d-919f-e0ae0cc0b40b" returned: 0 in 0.347s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.610s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-51657835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea0ebab-f168-4270-b7b8-b27be654239c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc00da5652c41f78c95020988152b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:44Z,use_quota=True,user_id='3b750a6f74344e87a49e0639d6297fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Creating volume eea0ebab-f168-4270-b7b8-b27be654239c {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:55 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:55 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c 1073741824 Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c44f8f9-bbd2-47ad-97a4-a419641cf276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9573951b-3da2-427d-919f-e0ae0cc0b40b', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:55 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c4a719-8c1f-467c-92da-b18f9d0ba7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:55 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Volume volume-9573951b-3da2-427d-919f-e0ae0cc0b40b (9573951b-3da2-427d-919f-e0ae0cc0b40b): created successfully Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c4a719-8c1f-467c-92da-b18f9d0ba7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Flow 'volume_create_manager' (17a16633-f36e-4d83-9114-6f21f7d5e5b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:55 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1b1559dd-6ff9-441b-86c8-14fc8fe2cb1b tempest-VolumesListAdminTestJSON-1092207319 None] Created volume successfully. Sep 28 17:11:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] Acquiring lock "cinder-5767b3b3-3df4-4116-a98b-904f10320f46-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] Lock "cinder-5767b3b3-3df4-4116-a98b-904f10320f46-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] Acquiring lock "cinder-quobyte-5767b3b3-3df4-4116-a98b-904f10320f46" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:56 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c 1073741824" returned: 0 in 0.689s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] Lock "cinder-quobyte-5767b3b3-3df4-4116-a98b-904f10320f46" acquired by "delete_volume" :: waited 0.038s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:56 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ef3748-04bc-479c-9db0-1b981aa20521]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:56 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c Sep 28 17:11:56 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:56 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 Sep 28 17:11:56 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:56 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c" returned: 0 in 0.350s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49a059c-cadb-45a1-b2b6-5cda1a2a5bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea0ebab-f168-4270-b7b8-b27be654239c', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008fc759-1a79-4a7a-8f11-cfc1122eab35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:56 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Volume volume-eea0ebab-f168-4270-b7b8-b27be654239c (eea0ebab-f168-4270-b7b8-b27be654239c): created successfully Sep 28 17:11:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008fc759-1a79-4a7a-8f11-cfc1122eab35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Flow 'volume_create_manager' (404b05df-877b-42af-b050-d6b673286eed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:56 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0e34813b-c24f-4695-bd1a-e0ccf25be8e1 tempest-VolumesExtendTest-1380153603 None] Created volume successfully. Sep 28 17:11:57 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46" returned: 0 in 0.630s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:57 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46 Sep 28 17:11:57 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:57 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5767b3b3-3df4-4116-a98b-904f10320f46" returned: 0 in 0.476s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] Lock "cinder-quobyte-5767b3b3-3df4-4116-a98b-904f10320f46" released by "delete_volume" :: held 1.186s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] Created reservations ['b6a2e749-78d5-4a73-95bc-a6f30dd33492', '23b880da-65e6-45a0-af26-679fd7968eaf', 'ecb17269-67bd-4c6f-9328-947fb0f50572', '8866e65e-06b1-4332-a522-79e8605eca9b'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Flow 'volume_create_manager' (dbfe5090-abe7-4e68-99a5-9eb41c4a9938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23130757-3238-4202-a0ba-97a19a1c8fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] Creating offline snapshot 70a69883-ab96-464c-a800-c459a0f8f7ca of volume eea0ebab-f168-4270-b7b8-b27be654239c {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23130757-3238-4202-a0ba-97a19a1c8fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f669229-0fe5-4903-8c86-23dfade7a703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7c26c5571743659d6e033a9218fcfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:58Z,use_quota=True,user_id='f229f33964444071a0ee1f3e20f453c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fc5d8c-c27c-488e-aef0-6cc4f9d413fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fc5d8c-c27c-488e-aef0-6cc4f9d413fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276f3693-d701-45ad-af4f-fab5bc623dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276f3693-d701-45ad-af4f-fab5bc623dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f669229-0fe5-4903-8c86-23dfade7a703', 'volume_name': 'volume-3f669229-0fe5-4903-8c86-23dfade7a703', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa98daaa-489a-4a09-a5ef-2bd233403383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa98daaa-489a-4a09-a5ef-2bd233403383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148b9caa-4442-447c-a1b4-1eecd150146c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:57 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Volume 3f669229-0fe5-4903-8c86-23dfade7a703: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f669229-0fe5-4903-8c86-23dfade7a703', 'volume_size': 1} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df06d70-4dd7-4b27-b9f9-bc1ba22a5ac8]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:58 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:11:58 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:58 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c Sep 28 17:11:58 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:58 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.341s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:58 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:58 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] Deleted volume successfully. Sep 28 17:11:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8fe96809-342e-4a28-a6aa-e93242467236 tempest-VolumesActionsTest-2038700812 None] Lock "cinder-5767b3b3-3df4-4116-a98b-904f10320f46-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:58 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c" returned: 0 in 0.542s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:58 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca 1G Sep 28 17:11:58 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:59 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca 1G" returned: 0 in 0.661s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea0ebab-f168-4270-b7b8-b27be654239c -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:59 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea0ebab-f168-4270-b7b8-b27be654239c -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca Sep 28 17:11:59 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:59 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea0ebab-f168-4270-b7b8-b27be654239c -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca" returned: 0 in 0.412s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:59 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca is being set with open permissions: ugo+rw Sep 28 17:11:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:59 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca Sep 28 17:11:59 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:59 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca" returned: 0 in 0.307s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:59 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.info Sep 28 17:11:59 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:00 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.info" returned: 0 in 0.354s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:00 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.info is being set with open permissions: ugo+rw Sep 28 17:12:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:00 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.info Sep 28 17:12:00 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:00 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.info" returned: 0 in 0.298s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.770s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.662s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f669229-0fe5-4903-8c86-23dfade7a703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7c26c5571743659d6e033a9218fcfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:58Z,use_quota=True,user_id='f229f33964444071a0ee1f3e20f453c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Creating volume 3f669229-0fe5-4903-8c86-23dfade7a703 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:00 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:12:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3f669229-0fe5-4903-8c86-23dfade7a703 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:00 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3f669229-0fe5-4903-8c86-23dfade7a703 1073741824 Sep 28 17:12:00 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:00 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-c919ac16-6224-4912-aa3f-923fb5e9a2bf tempest-VolumesExtendTest-1380153603 None] Create snapshot completed successfully Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f25f9eb6-f8ae-41f9-9faf-d37c42026669 tempest-VolumesExtendTest-1380153603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:01 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:12:01 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:01 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3f669229-0fe5-4903-8c86-23dfade7a703 1073741824" returned: 0 in 0.772s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3f669229-0fe5-4903-8c86-23dfade7a703 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:01 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3f669229-0fe5-4903-8c86-23dfade7a703 Sep 28 17:12:01 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:01 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.379s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:12:01 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3f669229-0fe5-4903-8c86-23dfade7a703" returned: 0 in 0.334s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f25f9eb6-f8ae-41f9-9faf-d37c42026669 tempest-VolumesExtendTest-1380153603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.704s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148b9caa-4442-447c-a1b4-1eecd150146c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f669229-0fe5-4903-8c86-23dfade7a703', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3590df05-c96f-4e1c-b3d1-71038ca20504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[9678fa88-9000-4828-9572-6042af8a8148]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f25f9eb6-f8ae-41f9-9faf-d37c42026669 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:01 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Volume volume-3f669229-0fe5-4903-8c86-23dfade7a703 (3f669229-0fe5-4903-8c86-23dfade7a703): created successfully Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3590df05-c96f-4e1c-b3d1-71038ca20504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Flow 'volume_create_manager' (dbfe5090-abe7-4e68-99a5-9eb41c4a9938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:01 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3eee0146-d750-47b9-8ec7-d718a147ad67 tempest-VolumesListAdminTestJSON-981842022 None] Created volume successfully. Sep 28 17:12:01 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c Sep 28 17:12:01 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:02 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f25f9eb6-f8ae-41f9-9faf-d37c42026669 tempest-VolumesExtendTest-1380153603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c" returned: 0 in 0.464s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f25f9eb6-f8ae-41f9-9faf-d37c42026669 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca 2G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f25f9eb6-f8ae-41f9-9faf-d37c42026669 tempest-VolumesExtendTest-1380153603 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca 2G" returned: 0 in 0.201s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f25f9eb6-f8ae-41f9-9faf-d37c42026669 tempest-VolumesExtendTest-1380153603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.738s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:02 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-f25f9eb6-f8ae-41f9-9faf-d37c42026669 tempest-VolumesExtendTest-1380153603 None] Extend volume completed successfully. Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] Acquiring lock "cinder-3f669229-0fe5-4903-8c86-23dfade7a703-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] Lock "cinder-3f669229-0fe5-4903-8c86-23dfade7a703-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] Acquiring lock "cinder-quobyte-3f669229-0fe5-4903-8c86-23dfade7a703" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] Lock "cinder-quobyte-3f669229-0fe5-4903-8c86-23dfade7a703" acquired by "delete_volume" :: waited 0.013s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c084acd-82e5-47c3-bc4d-c21a32d850a9]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3f669229-0fe5-4903-8c86-23dfade7a703 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] Acquiring lock "cinder-9573951b-3da2-427d-919f-e0ae0cc0b40b-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "cinder-9573951b-3da2-427d-919f-e0ae0cc0b40b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] Acquiring lock "cinder-quobyte-9573951b-3da2-427d-919f-e0ae0cc0b40b" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "cinder-quobyte-9573951b-3da2-427d-919f-e0ae0cc0b40b" acquired by "delete_volume" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:03 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3f669229-0fe5-4903-8c86-23dfade7a703 Sep 28 17:12:03 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22fad88-56dd-40a2-9cd0-b3fc76e6913f]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9573951b-3da2-427d-919f-e0ae0cc0b40b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] Acquiring lock "cinder-70a69883-ab96-464c-a800-c459a0f8f7ca-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] Lock "cinder-70a69883-ab96-464c-a800-c459a0f8f7ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] Acquiring lock "cinder-quobyte-eea0ebab-f168-4270-b7b8-b27be654239c" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] Lock "cinder-quobyte-eea0ebab-f168-4270-b7b8-b27be654239c" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] Acquiring lock "cinder-quobyte-70a69883-ab96-464c-a800-c459a0f8f7ca" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:03 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9573951b-3da2-427d-919f-e0ae0cc0b40b Sep 28 17:12:03 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] Lock "cinder-quobyte-70a69883-ab96-464c-a800-c459a0f8f7ca" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] Deleting offline snapshot 70a69883-ab96-464c-a800-c459a0f8f7ca of volume eea0ebab-f168-4270-b7b8-b27be654239c {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] snapshot_file for this snap is: volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aa3e36-7c10-42d1-9837-d21fbb195cc3]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:03 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3f669229-0fe5-4903-8c86-23dfade7a703" returned: 0 in 0.618s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3f669229-0fe5-4903-8c86-23dfade7a703 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:04 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3f669229-0fe5-4903-8c86-23dfade7a703 Sep 28 17:12:04 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:04 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca Sep 28 17:12:04 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:04 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9573951b-3da2-427d-919f-e0ae0cc0b40b" returned: 0 in 0.821s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9573951b-3da2-427d-919f-e0ae0cc0b40b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:04 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9573951b-3da2-427d-919f-e0ae0cc0b40b Sep 28 17:12:04 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:04 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3f669229-0fe5-4903-8c86-23dfade7a703" returned: 0 in 0.587s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] Lock "cinder-quobyte-3f669229-0fe5-4903-8c86-23dfade7a703" released by "delete_volume" :: held 1.283s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:04 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca" returned: 0 in 0.789s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eea0ebab-f168-4270-b7b8-b27be654239c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c49b70-5b93-4dc9-9f8f-bfa58177e3c5]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] Created reservations ['3fa941d3-6db6-486f-9f7b-3780e6e4ea5e', 'f7325ec5-ffc9-4cbe-8f9a-d97b1a3c0b83', 'b644a611-06da-4259-bbe3-f38fc8d5acff', 'd224db83-85f7-4a6a-8ab1-f433a1fd942f'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Flow 'volume_create_manager' (80ed3477-44b1-4c05-b958-56a51debcb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305e4337-36c4-437b-b188-1f01ba84be8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305e4337-36c4-437b-b188-1f01ba84be8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-186164316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9106f06-9f64-4654-8a46-71c35e5950f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c6dcc65fb2f42929365ff1b1726bc0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:05Z,use_quota=True,user_id='933bc267bcb341a392de2e7e2b084808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fe7b56-3aea-4320-9749-130378518744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fe7b56-3aea-4320-9749-130378518744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:04 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c Sep 28 17:12:04 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceef8050-a38a-434c-a264-68806b802894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceef8050-a38a-434c-a264-68806b802894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9106f06-9f64-4654-8a46-71c35e5950f6', 'volume_name': 'volume-f9106f06-9f64-4654-8a46-71c35e5950f6', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0dd573-a615-4cfd-9afe-220cdab547d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:04 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0dd573-a615-4cfd-9afe-220cdab547d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f46e9d9-e4ce-4277-b85d-e8fb726b7ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:04 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Volume f9106f06-9f64-4654-8a46-71c35e5950f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9106f06-9f64-4654-8a46-71c35e5950f6', 'volume_size': 1} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-186164316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9106f06-9f64-4654-8a46-71c35e5950f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c6dcc65fb2f42929365ff1b1726bc0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:05Z,use_quota=True,user_id='933bc267bcb341a392de2e7e2b084808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Creating volume f9106f06-9f64-4654-8a46-71c35e5950f6 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:04 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9573951b-3da2-427d-919f-e0ae0cc0b40b" returned: 0 in 0.535s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:04 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6 1073741824 Sep 28 17:12:04 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "cinder-quobyte-9573951b-3da2-427d-919f-e0ae0cc0b40b" released by "delete_volume" :: held 1.442s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:05 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:12:05 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] Created reservations ['45543301-e555-4ed8-bbed-c11e7139372e', '76446157-a126-4d51-b1a1-045a1d20d748', '430ef719-59d1-4b89-a7cc-751d8f8f3013', '3a95730e-dac8-4547-981a-ac44c2c20cf5'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:05 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c" returned: 0 in 0.628s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:05 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:12:05 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:05 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca Sep 28 17:12:05 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:05 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.458s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:05 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] Deleted volume successfully. Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42a73c9d-832b-41ae-88f7-eed8293cf324 tempest-VolumesListAdminTestJSON-981842022 None] Lock "cinder-3f669229-0fe5-4903-8c86-23dfade7a703-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:05 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6 1073741824" returned: 0 in 0.753s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:05 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.423s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:05 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] Deleted volume successfully. Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:05 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6 Sep 28 17:12:05 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6822347e-08be-4a08-9bbb-8dd4c561b6a5 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "cinder-9573951b-3da2-427d-919f-e0ae0cc0b40b-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] Acquiring lock "cinder-8d4310cb-776b-48c4-8afe-63bfcd6413f5-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:05 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca" returned: 0 in 0.665s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] Lock "cinder-8d4310cb-776b-48c4-8afe-63bfcd6413f5-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:06 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca Sep 28 17:12:06 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] Acquiring lock "cinder-quobyte-8d4310cb-776b-48c4-8afe-63bfcd6413f5" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] Lock "cinder-quobyte-8d4310cb-776b-48c4-8afe-63bfcd6413f5" acquired by "delete_volume" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f2d82e-b198-4298-9b22-027914c52562]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d4310cb-776b-48c4-8afe-63bfcd6413f5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:06 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6" returned: 0 in 0.501s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f46e9d9-e4ce-4277-b85d-e8fb726b7ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9106f06-9f64-4654-8a46-71c35e5950f6', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad426d22-f47f-493a-9172-587acd24b514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:06 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d4310cb-776b-48c4-8afe-63bfcd6413f5 Sep 28 17:12:06 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:06 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Volume volume-f9106f06-9f64-4654-8a46-71c35e5950f6 (f9106f06-9f64-4654-8a46-71c35e5950f6): created successfully Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad426d22-f47f-493a-9172-587acd24b514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Flow 'volume_create_manager' (80ed3477-44b1-4c05-b958-56a51debcb14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:06 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-bcd58ee4-99e5-45db-910b-c127115c7bd3 tempest-SnapshotMetadataTestJSON-680991063 None] Created volume successfully. Sep 28 17:12:06 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c.70a69883-ab96-464c-a800-c459a0f8f7ca" returned: 0 in 0.377s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] Lock "cinder-quobyte-70a69883-ab96-464c-a800-c459a0f8f7ca" released by "_delete_snapshot" :: held 2.651s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] Lock "cinder-quobyte-eea0ebab-f168-4270-b7b8-b27be654239c" released by "delete_snapshot" :: held 2.692s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] Created reservations ['169142fe-32d2-4539-879a-ef9e808d5894', 'aeacd3a1-c411-4dcb-a263-092548fbb8ae', 'efb3ee25-d729-4db3-9e6e-21570add61b0', 'cad42ecd-567d-4601-ae99-a6cf61578f17'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:06 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:06 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] Delete snapshot completed successfully. Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d4310cb-776b-48c4-8afe-63bfcd6413f5" returned: 0 in 0.485s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d4310cb-776b-48c4-8afe-63bfcd6413f5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42f389ed-1726-46f4-97af-e7fd2a7b9d01 tempest-VolumesExtendTest-1380153603 None] Lock "cinder-70a69883-ab96-464c-a800-c459a0f8f7ca-delete_snapshot" released by "delete_snapshot" :: held 2.948s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:06 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d4310cb-776b-48c4-8afe-63bfcd6413f5 Sep 28 17:12:06 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:06 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d4310cb-776b-48c4-8afe-63bfcd6413f5" returned: 0 in 0.380s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] Lock "cinder-quobyte-8d4310cb-776b-48c4-8afe-63bfcd6413f5" released by "delete_volume" :: held 0.947s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] Acquiring lock "cinder-eea0ebab-f168-4270-b7b8-b27be654239c-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] Lock "cinder-eea0ebab-f168-4270-b7b8-b27be654239c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] Created reservations ['2e114539-b1f1-42f5-bad3-5068fdaa72c5', 'de94c825-9c57-44ab-8d99-9649bcaa2755', 'b1d0059c-e3de-4f4e-a95a-c28351f3511d', '5cdca096-004f-4d96-b28a-018d2bca18a5'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] Acquiring lock "cinder-quobyte-eea0ebab-f168-4270-b7b8-b27be654239c" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] Creating offline snapshot 4317f4de-db79-4aa6-916d-be357afab0fe of volume f9106f06-9f64-4654-8a46-71c35e5950f6 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] Lock "cinder-quobyte-eea0ebab-f168-4270-b7b8-b27be654239c" acquired by "delete_volume" :: waited 0.049s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[72887fbe-3523-4bca-8078-0b9098a3bb55]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b9bc1e-3c26-4dc8-822a-8c6742407613]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:07 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6 Sep 28 17:12:07 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:07 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:12:07 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:07 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c Sep 28 17:12:07 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:07 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.333s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:07 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:07 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] Deleted volume successfully. Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6" returned: 0 in 0.466s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:07 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe 1G Sep 28 17:12:07 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a561c403-8fe7-4aed-9234-579d88141e9e tempest-VolumesListAdminTestJSON-1092207319 None] Lock "cinder-8d4310cb-776b-48c4-8afe-63bfcd6413f5-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:08 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c" returned: 0 in 0.662s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:08 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c Sep 28 17:12:08 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:08 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea0ebab-f168-4270-b7b8-b27be654239c" returned: 0 in 0.342s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] Lock "cinder-quobyte-eea0ebab-f168-4270-b7b8-b27be654239c" released by "delete_volume" :: held 1.121s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:08 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe 1G" returned: 0 in 0.658s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9106f06-9f64-4654-8a46-71c35e5950f6 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] Acquiring lock "cinder-9c83e48e-5d92-43a4-a970-af9c8f5ea54b-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] Created reservations ['f78cccb7-977f-4983-9681-526309f261b5', 'b0bb34f8-0ef7-4c14-ac42-101164e0b74c', '10766df0-cba7-4def-bf5c-8f1fa9a2b5ca', 'b89d0e40-3b31-413d-b15b-e0fa8ec36427'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:08 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9106f06-9f64-4654-8a46-71c35e5950f6 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe Sep 28 17:12:08 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "cinder-9c83e48e-5d92-43a4-a970-af9c8f5ea54b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] Acquiring lock "cinder-quobyte-9c83e48e-5d92-43a4-a970-af9c8f5ea54b" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "cinder-quobyte-9c83e48e-5d92-43a4-a970-af9c8f5ea54b" acquired by "delete_volume" :: waited 0.051s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:08 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:12:08 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45f5d5c-2997-4018-8f62-e9fdaefbcbbe]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c83e48e-5d92-43a4-a970-af9c8f5ea54b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:08 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c83e48e-5d92-43a4-a970-af9c8f5ea54b Sep 28 17:12:08 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:08 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9106f06-9f64-4654-8a46-71c35e5950f6 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe" returned: 0 in 0.494s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:08 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe is being set with open permissions: ugo+rw Sep 28 17:12:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:09 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe Sep 28 17:12:09 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:09 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.470s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:09 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] Deleted volume successfully. Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-746e809a-b227-44c0-a44a-c4fc0bc5bdfe tempest-VolumesExtendTest-1380153603 None] Lock "cinder-eea0ebab-f168-4270-b7b8-b27be654239c-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:09 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c83e48e-5d92-43a4-a970-af9c8f5ea54b" returned: 0 in 0.524s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c83e48e-5d92-43a4-a970-af9c8f5ea54b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:09 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c83e48e-5d92-43a4-a970-af9c8f5ea54b Sep 28 17:12:09 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:09 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe" returned: 0 in 0.401s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:09 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.info Sep 28 17:12:09 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:09 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c83e48e-5d92-43a4-a970-af9c8f5ea54b" returned: 0 in 0.344s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "cinder-quobyte-9c83e48e-5d92-43a4-a970-af9c8f5ea54b" released by "delete_volume" :: held 0.949s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] Created reservations ['70ac5f24-775e-4515-967e-b6794e83666c', '422ff829-ad0c-4a1c-b70f-5f28ec7d486c', 'fe850e30-11d1-47af-b3a9-91305ed7bab1', 'b3f9b289-a29a-4476-948e-ffd533ced579'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:09 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:12:09 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:09 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.info" returned: 0 in 0.478s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:09 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.info is being set with open permissions: ugo+rw Sep 28 17:12:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:09 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.info Sep 28 17:12:10 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:10 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.info" returned: 0 in 0.398s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.131s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:10 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-7e1d0c51-eb36-4861-a0c1-ce9505e8a48e tempest-SnapshotMetadataTestJSON-680991063 None] Create snapshot completed successfully Sep 28 17:12:10 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.549s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:10 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:10 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] Deleted volume successfully. Sep 28 17:12:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d8ac3cc8-f4de-40fe-a9fe-285a640a63c2 tempest-VolumesListAdminTestJSON-1092207319 None] Lock "cinder-9c83e48e-5d92-43a4-a970-af9c8f5ea54b-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Flow 'volume_create_manager' (9aa8836a-641a-4f81-aec6-d354821badca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e75a9c2-8897-4c7f-87d5-41a75c617445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e75a9c2-8897-4c7f-87d5-41a75c617445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2068088589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c172306-12bd-43bc-8d2b-e079ba40d79c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a203abf688409e8fc533096a30d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:11Z,use_quota=True,user_id='cac37842b0764a98ac35a80d3d307cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331a426c-1156-4687-b760-39ec7e91541c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331a426c-1156-4687-b760-39ec7e91541c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd3279f-a016-4819-a124-f4b1e9f06643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd3279f-a016-4819-a124-f4b1e9f06643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c172306-12bd-43bc-8d2b-e079ba40d79c', 'volume_name': 'volume-6c172306-12bd-43bc-8d2b-e079ba40d79c', 'volume_size': 2}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d68b83e-0b7f-4986-86fb-431daffdf2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d68b83e-0b7f-4986-86fb-431daffdf2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937b1342-5d48-4c18-809e-822a60276af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:11 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Volume 6c172306-12bd-43bc-8d2b-e079ba40d79c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c172306-12bd-43bc-8d2b-e079ba40d79c', 'volume_size': 2} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2068088589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c172306-12bd-43bc-8d2b-e079ba40d79c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a203abf688409e8fc533096a30d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:11Z,use_quota=True,user_id='cac37842b0764a98ac35a80d3d307cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Creating volume 6c172306-12bd-43bc-8d2b-e079ba40d79c {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:11 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6c172306-12bd-43bc-8d2b-e079ba40d79c 2147483648 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:11 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6c172306-12bd-43bc-8d2b-e079ba40d79c 2147483648 Sep 28 17:12:11 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:11 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6c172306-12bd-43bc-8d2b-e079ba40d79c 2147483648" returned: 0 in 0.790s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6c172306-12bd-43bc-8d2b-e079ba40d79c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:12 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6c172306-12bd-43bc-8d2b-e079ba40d79c Sep 28 17:12:12 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:12 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6c172306-12bd-43bc-8d2b-e079ba40d79c" returned: 0 in 0.368s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937b1342-5d48-4c18-809e-822a60276af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c172306-12bd-43bc-8d2b-e079ba40d79c', 'volume_size': 2}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f263d5d-17ff-4c14-87e4-0ea82e804a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:12 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Volume volume-6c172306-12bd-43bc-8d2b-e079ba40d79c (6c172306-12bd-43bc-8d2b-e079ba40d79c): created successfully Sep 28 17:12:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f263d5d-17ff-4c14-87e4-0ea82e804a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Flow 'volume_create_manager' (9aa8836a-641a-4f81-aec6-d354821badca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:12 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1cad6020-37f7-4a60-bdf4-8aa9f13c840f tempest-VolumesCloneNegativeTest-224424981 None] Created volume successfully. Sep 28 17:12:12 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] Acquiring lock "cinder-4317f4de-db79-4aa6-916d-be357afab0fe-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:12 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] Lock "cinder-4317f4de-db79-4aa6-916d-be357afab0fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:12 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] Acquiring lock "cinder-quobyte-f9106f06-9f64-4654-8a46-71c35e5950f6" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:12 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] Lock "cinder-quobyte-f9106f06-9f64-4654-8a46-71c35e5950f6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:12 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] Acquiring lock "cinder-quobyte-4317f4de-db79-4aa6-916d-be357afab0fe" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:12 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] Lock "cinder-quobyte-4317f4de-db79-4aa6-916d-be357afab0fe" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] Deleting offline snapshot 4317f4de-db79-4aa6-916d-be357afab0fe of volume f9106f06-9f64-4654-8a46-71c35e5950f6 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:12:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] snapshot_file for this snap is: volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:12:13 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fb3fdb-89f9-43c9-ab74-ffe84e5efa6a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:13 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe Sep 28 17:12:13 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] Acquiring lock "cinder-6c172306-12bd-43bc-8d2b-e079ba40d79c-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] Lock "cinder-6c172306-12bd-43bc-8d2b-e079ba40d79c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] Acquiring lock "cinder-quobyte-6c172306-12bd-43bc-8d2b-e079ba40d79c" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] Lock "cinder-quobyte-6c172306-12bd-43bc-8d2b-e079ba40d79c" acquired by "delete_volume" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:13 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe" returned: 0 in 0.482s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:13 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9106f06-9f64-4654-8a46-71c35e5950f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:13 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5aabdcf-836e-4c1f-b774-be7fe7140dc4]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6c172306-12bd-43bc-8d2b-e079ba40d79c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:13 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4ff31d-7f1a-4099-bf66-a491a56afda1]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:13 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6 Sep 28 17:12:13 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:13 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6c172306-12bd-43bc-8d2b-e079ba40d79c Sep 28 17:12:13 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:14 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6" returned: 0 in 0.564s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:14 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe Sep 28 17:12:14 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:14 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6c172306-12bd-43bc-8d2b-e079ba40d79c" returned: 0 in 0.701s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6c172306-12bd-43bc-8d2b-e079ba40d79c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:14 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6c172306-12bd-43bc-8d2b-e079ba40d79c Sep 28 17:12:14 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:14 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:14 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe" returned: 0 in 0.526s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6c172306-12bd-43bc-8d2b-e079ba40d79c" returned: 0 in 0.409s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] Lock "cinder-quobyte-6c172306-12bd-43bc-8d2b-e079ba40d79c" released by "delete_volume" :: held 1.218s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:14 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe Sep 28 17:12:14 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:14 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] Created reservations ['ba376104-d53b-49ac-95f0-3be972a8ef76', '42b67b60-22dd-47a1-825c-183f282e5358', 'fc6c90dc-05e9-4363-b2de-847b27573e3b', '09899480-41f6-4f55-b1cb-9c7c58a90b8c'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:14 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:14 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:14 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:12:14 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:15 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6.4317f4de-db79-4aa6-916d-be357afab0fe" returned: 0 in 0.547s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:15 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.376s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] Lock "cinder-quobyte-4317f4de-db79-4aa6-916d-be357afab0fe" released by "_delete_snapshot" :: held 2.330s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:15 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] Deleted volume successfully. Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] Lock "cinder-quobyte-f9106f06-9f64-4654-8a46-71c35e5950f6" released by "delete_snapshot" :: held 2.361s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3ac5ad95-0cfa-49dc-8e21-1d4caf07fa3d tempest-VolumesCloneNegativeTest-224424981 None] Lock "cinder-6c172306-12bd-43bc-8d2b-e079ba40d79c-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] Created reservations ['97c1a2f3-dc03-444f-a8e0-15339c63b8dd', '404f54e5-734a-42f6-973b-c57c9ee91c72', 'd44ec455-0c3c-4059-b55f-fa3c0b3e7389', '7376229d-cebf-4bdf-82d8-9afb139d271d'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Flow 'volume_create_manager' (0b6e88f6-7dec-4de5-9aac-1eb6fc7069f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648f1971-36fe-45f4-9c25-6c506581b5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648f1971-36fe-45f4-9c25-6c506581b5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1571704102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d143e9-ecb5-4e90-9787-d623a005aa3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb5dd4491ad54b5b901de14b8c9a476d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:15Z,use_quota=True,user_id='50043fafd6fa402b8165490e4f06ca8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f4261c-e0a4-4725-99d9-cc17e24ed33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f4261c-e0a4-4725-99d9-cc17e24ed33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde9b447-0072-41b4-ba31-1c524dae6352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde9b447-0072-41b4-ba31-1c524dae6352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6d143e9-ecb5-4e90-9787-d623a005aa3c', 'volume_name': 'volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e117c2-8e4c-4293-be6e-ee62118c10c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e117c2-8e4c-4293-be6e-ee62118c10c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6a9f8c-bad3-452b-8759-8279191380e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:15 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Volume f6d143e9-ecb5-4e90-9787-d623a005aa3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c', 'volume_size': 1} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1571704102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d143e9-ecb5-4e90-9787-d623a005aa3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb5dd4491ad54b5b901de14b8c9a476d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:15Z,use_quota=True,user_id='50043fafd6fa402b8165490e4f06ca8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Creating volume f6d143e9-ecb5-4e90-9787-d623a005aa3c {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:15 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:15 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c 1073741824 Sep 28 17:12:15 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:15 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] Delete snapshot completed successfully. Sep 28 17:12:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2c2a8f97-3031-41a0-a8b2-bafbf3e497bb tempest-SnapshotMetadataTestJSON-680991063 None] Lock "cinder-4317f4de-db79-4aa6-916d-be357afab0fe-delete_snapshot" released by "delete_snapshot" :: held 2.713s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:16 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c 1073741824" returned: 0 in 0.690s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] Acquiring lock "cinder-f9106f06-9f64-4654-8a46-71c35e5950f6-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:16 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c Sep 28 17:12:16 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] Lock "cinder-f9106f06-9f64-4654-8a46-71c35e5950f6-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] Acquiring lock "cinder-quobyte-f9106f06-9f64-4654-8a46-71c35e5950f6" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] Lock "cinder-quobyte-f9106f06-9f64-4654-8a46-71c35e5950f6" acquired by "delete_volume" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:16 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dd322a-3395-4601-84e1-885ff84f9816]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:16 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6 Sep 28 17:12:16 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:16 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c" returned: 0 in 0.486s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6a9f8c-bad3-452b-8759-8279191380e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209783cd-9e3a-4256-9c43-ac25c4bf57e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:16 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Volume volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c (f6d143e9-ecb5-4e90-9787-d623a005aa3c): created successfully Sep 28 17:12:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209783cd-9e3a-4256-9c43-ac25c4bf57e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Flow 'volume_create_manager' (0b6e88f6-7dec-4de5-9aac-1eb6fc7069f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:16 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ba15e212-60b2-4165-9ab4-5cd7b08bf1ec tempest-VolumesSnapshotListTestJSON-1166373603 None] Created volume successfully. Sep 28 17:12:17 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6" returned: 0 in 0.534s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:17 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6 Sep 28 17:12:17 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:17 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f9106f06-9f64-4654-8a46-71c35e5950f6" returned: 0 in 0.355s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] Lock "cinder-quobyte-f9106f06-9f64-4654-8a46-71c35e5950f6" released by "delete_volume" :: held 1.038s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:17 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] Created reservations ['d0adb228-660e-4886-97f9-827990d106f9', 'bf959905-a6e5-4c98-b637-445af2c259c7', '4b8587b4-4d45-447b-9d19-cf57f2aaf0c2', '1578e251-80d7-4c3f-903b-2df23452fea6'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:17 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:12:17 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Creating offline snapshot c10c1895-e030-4806-b9e1-16de468d1f21 of volume f6d143e9-ecb5-4e90-9787-d623a005aa3c {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:12:18 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aea7d3-86d0-4d8b-bbb1-bfdf446fe51f]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:18 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.391s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:18 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:18 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c Sep 28 17:12:18 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:18 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] Deleted volume successfully. Sep 28 17:12:18 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-43a7438a-0f28-43bc-8a7e-725642b4545a tempest-SnapshotMetadataTestJSON-680991063 None] Lock "cinder-f9106f06-9f64-4654-8a46-71c35e5950f6-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:18 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c" returned: 0 in 0.559s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:18 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 1G Sep 28 17:12:18 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:19 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 1G" returned: 0 in 0.640s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:19 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 Sep 28 17:12:19 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:19 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21" returned: 0 in 0.395s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:19 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 is being set with open permissions: ugo+rw Sep 28 17:12:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:19 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 Sep 28 17:12:19 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:19 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21" returned: 0 in 0.333s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:20 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.info Sep 28 17:12:20 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:20 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.info" returned: 0 in 0.425s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:20 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.info is being set with open permissions: ugo+rw Sep 28 17:12:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:20 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.info Sep 28 17:12:20 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:20 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.info" returned: 0 in 0.504s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.042s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:21 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a3922b47-8255-4858-8bb5-954ef0775cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Create snapshot completed successfully Sep 28 17:12:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9c680821-1638-4ed0-a4ce-cd094623c675 tempest-VolumesSnapshotListTestJSON-1166373603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9c680821-1638-4ed0-a4ce-cd094623c675 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-9c680821-1638-4ed0-a4ce-cd094623c675 tempest-VolumesSnapshotListTestJSON-1166373603 None] Creating offline snapshot 65a4e8a6-fb34-433e-890f-ada1caa11cb3 of volume f6d143e9-ecb5-4e90-9787-d623a005aa3c {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:12:21 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[447f9e48-6c2c-421e-a27a-e23bf4c16960]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9c680821-1638-4ed0-a4ce-cd094623c675 tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:21 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 Sep 28 17:12:21 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:22 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9c680821-1638-4ed0-a4ce-cd094623c675 tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21" returned: 0 in 0.623s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-9c680821-1638-4ed0-a4ce-cd094623c675 tempest-VolumesSnapshotListTestJSON-1166373603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9c680821-1638-4ed0-a4ce-cd094623c675 tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:22 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 1G Sep 28 17:12:22 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:22 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Flow 'volume_create_manager' (3bca9fdc-c2eb-4dfe-b8d6-70bac5896df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c38fd1-25d7-4f68-be2c-419ec73ccce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c38fd1-25d7-4f68-be2c-419ec73ccce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1091581851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac3df5f-5b70-4f91-ba10-fbc3258b924b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='aac3176978694ef49aeed5083a9b17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:23Z,use_quota=True,user_id='7054348844054a8d8d1254e8645685f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875dc5bf-3be6-409d-98b9-b558d53c9cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875dc5bf-3be6-409d-98b9-b558d53c9cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8008ab5c-f995-4090-8703-6cd6b66fc135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8008ab5c-f995-4090-8703-6cd6b66fc135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ac3df5f-5b70-4f91-ba10-fbc3258b924b', 'volume_name': 'volume-9ac3df5f-5b70-4f91-ba10-fbc3258b924b', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52cda23e-5719-4227-bd95-b3dac872dd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52cda23e-5719-4227-bd95-b3dac872dd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4bba9a3-d1bf-488f-bc89-97e7275d59ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:23 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Volume 9ac3df5f-5b70-4f91-ba10-fbc3258b924b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ac3df5f-5b70-4f91-ba10-fbc3258b924b', 'volume_size': 1} Sep 28 17:12:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:23 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9c680821-1638-4ed0-a4ce-cd094623c675 tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 1G" returned: 0 in 0.801s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9c680821-1638-4ed0-a4ce-cd094623c675 tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:23 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 Sep 28 17:12:23 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:23 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9c680821-1638-4ed0-a4ce-cd094623c675 tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3" returned: 0 in 0.383s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:23 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-9c680821-1638-4ed0-a4ce-cd094623c675 tempest-VolumesSnapshotListTestJSON-1166373603 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 is being set with open permissions: ugo+rw Sep 28 17:12:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9c680821-1638-4ed0-a4ce-cd094623c675 tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:23 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 Sep 28 17:12:23 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:23 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9c680821-1638-4ed0-a4ce-cd094623c675 tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3" returned: 0 in 0.311s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9c680821-1638-4ed0-a4ce-cd094623c675 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.299s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.870s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:23 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1091581851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac3df5f-5b70-4f91-ba10-fbc3258b924b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='aac3176978694ef49aeed5083a9b17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:23Z,use_quota=True,user_id='7054348844054a8d8d1254e8645685f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:23 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Creating volume 9ac3df5f-5b70-4f91-ba10-fbc3258b924b {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:23 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:23 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:23 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:23 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:12:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ac3df5f-5b70-4f91-ba10-fbc3258b924b 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:23 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ac3df5f-5b70-4f91-ba10-fbc3258b924b 1073741824 Sep 28 17:12:23 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:23 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-9c680821-1638-4ed0-a4ce-cd094623c675 tempest-VolumesSnapshotListTestJSON-1166373603 None] Create snapshot completed successfully Sep 28 17:12:24 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ac3df5f-5b70-4f91-ba10-fbc3258b924b 1073741824" returned: 0 in 0.628s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ac3df5f-5b70-4f91-ba10-fbc3258b924b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:24 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ac3df5f-5b70-4f91-ba10-fbc3258b924b Sep 28 17:12:24 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:24 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ac3df5f-5b70-4f91-ba10-fbc3258b924b" returned: 0 in 0.359s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4bba9a3-d1bf-488f-bc89-97e7275d59ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ac3df5f-5b70-4f91-ba10-fbc3258b924b', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e160a12-8947-431a-a852-4812bf701f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:24 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Volume volume-9ac3df5f-5b70-4f91-ba10-fbc3258b924b (9ac3df5f-5b70-4f91-ba10-fbc3258b924b): created successfully Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e160a12-8947-431a-a852-4812bf701f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Flow 'volume_create_manager' (3bca9fdc-c2eb-4dfe-b8d6-70bac5896df6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:25 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1533dcfe-97f9-4cf9-aa46-7ce4b5152c0d tempest-VolumesGetTest-1604525800 None] Created volume successfully. Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-204619b8-fab8-467c-a317-f08ba2dd0cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-204619b8-fab8-467c-a317-f08ba2dd0cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-204619b8-fab8-467c-a317-f08ba2dd0cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Creating offline snapshot 9b58d4f1-d783-4e56-a024-888b6f4a2817 of volume f6d143e9-ecb5-4e90-9787-d623a005aa3c {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d06acfd-2f66-4a51-bcc7-c44fee614d6f]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-204619b8-fab8-467c-a317-f08ba2dd0cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:25 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 Sep 28 17:12:25 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Flow 'volume_create_manager' (cfe98e44-8f0d-4171-9c23-65db6ee3b679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d2b9be-c757-4023-bca2-0e29cb70fe75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d2b9be-c757-4023-bca2-0e29cb70fe75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-412494813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf069de1-c277-4d04-bd2b-f87ab1ad5f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bbfdc5725347ddbd9edea4b875d5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:25Z,use_quota=True,user_id='50acf5825d1e4408a4c1acc53f7ed4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a858367-138c-4af1-a9df-67b1e296e945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a858367-138c-4af1-a9df-67b1e296e945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652173c4-7219-4edf-a119-c355c3891a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652173c4-7219-4edf-a119-c355c3891a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf069de1-c277-4d04-bd2b-f87ab1ad5f9e', 'volume_name': 'volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91523f8d-2fe1-4fb2-8267-7b6fbbffd77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91523f8d-2fe1-4fb2-8267-7b6fbbffd77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a577bec6-e55d-4c25-92d0-d304bbbb4b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:25 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Volume bf069de1-c277-4d04-bd2b-f87ab1ad5f9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e', 'volume_size': 1} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:25 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-204619b8-fab8-467c-a317-f08ba2dd0cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3" returned: 0 in 0.477s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-204619b8-fab8-467c-a317-f08ba2dd0cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-204619b8-fab8-467c-a317-f08ba2dd0cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:25 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817 1G Sep 28 17:12:25 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:26 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-204619b8-fab8-467c-a317-f08ba2dd0cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817 1G" returned: 0 in 0.645s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-204619b8-fab8-467c-a317-f08ba2dd0cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:26 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817 Sep 28 17:12:26 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:26 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-204619b8-fab8-467c-a317-f08ba2dd0cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817" returned: 0 in 0.380s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:26 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-204619b8-fab8-467c-a317-f08ba2dd0cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817 is being set with open permissions: ugo+rw Sep 28 17:12:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-204619b8-fab8-467c-a317-f08ba2dd0cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:26 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817 Sep 28 17:12:26 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:27 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-204619b8-fab8-467c-a317-f08ba2dd0cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817" returned: 0 in 0.312s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-204619b8-fab8-467c-a317-f08ba2dd0cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-412494813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf069de1-c277-4d04-bd2b-f87ab1ad5f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bbfdc5725347ddbd9edea4b875d5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:25Z,use_quota=True,user_id='50acf5825d1e4408a4c1acc53f7ed4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Creating volume bf069de1-c277-4d04-bd2b-f87ab1ad5f9e {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:27 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:27 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e 1073741824 Sep 28 17:12:27 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:27 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-204619b8-fab8-467c-a317-f08ba2dd0cfe tempest-VolumesSnapshotListTestJSON-1166373603 None] Create snapshot completed successfully Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Flow 'volume_create_manager' (df8ba1bf-039d-4567-ac78-f43c95bb493d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ca382d-32f5-4823-9d7b-ab7215371830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ca382d-32f5-4823-9d7b-ab7215371830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1069984866',display_name='tempest-VolumesGetTest-Volume-83573220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00015507-c816-4243-a0ee-22dcbda7d6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac3176978694ef49aeed5083a9b17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:28Z,use_quota=True,user_id='7054348844054a8d8d1254e8645685f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2622a8-c69f-4131-9577-e577b4bb6d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2622a8-c69f-4131-9577-e577b4bb6d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f1f356-6444-45b7-a790-6ec175bfd89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f1f356-6444-45b7-a790-6ec175bfd89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00015507-c816-4243-a0ee-22dcbda7d6a1', 'volume_name': 'volume-00015507-c816-4243-a0ee-22dcbda7d6a1', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57730af9-fee6-40cf-9e40-69fe2e29290e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57730af9-fee6-40cf-9e40-69fe2e29290e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbd5345-fd92-4847-b6f8-9a328b9a5380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:27 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Volume 00015507-c816-4243-a0ee-22dcbda7d6a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00015507-c816-4243-a0ee-22dcbda7d6a1', 'volume_size': 1} Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:27 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e 1073741824" returned: 0 in 0.792s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:28 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e Sep 28 17:12:28 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:28 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e" returned: 0 in 0.341s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.462s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1069984866',display_name='tempest-VolumesGetTest-Volume-83573220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00015507-c816-4243-a0ee-22dcbda7d6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac3176978694ef49aeed5083a9b17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:28Z,use_quota=True,user_id='7054348844054a8d8d1254e8645685f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Creating volume 00015507-c816-4243-a0ee-22dcbda7d6a1 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:28 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-00015507-c816-4243-a0ee-22dcbda7d6a1 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a577bec6-e55d-4c25-92d0-d304bbbb4b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:28 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-00015507-c816-4243-a0ee-22dcbda7d6a1 1073741824 Sep 28 17:12:28 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb24a3d-4e81-4e41-bd18-4ebbe8d14059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:28 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Volume volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e (bf069de1-c277-4d04-bd2b-f87ab1ad5f9e): created successfully Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb24a3d-4e81-4e41-bd18-4ebbe8d14059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Flow 'volume_create_manager' (cfe98e44-8f0d-4171-9c23-65db6ee3b679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:28 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-766493a4-9439-4459-ae19-78ca3f88a934 tempest-VolumesDeleteCascade-1970734814 None] Created volume successfully. Sep 28 17:12:29 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-00015507-c816-4243-a0ee-22dcbda7d6a1 1073741824" returned: 0 in 0.736s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-00015507-c816-4243-a0ee-22dcbda7d6a1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:29 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-00015507-c816-4243-a0ee-22dcbda7d6a1 Sep 28 17:12:29 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Acquiring lock "cinder-9b58d4f1-d783-4e56-a024-888b6f4a2817-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-9b58d4f1-d783-4e56-a024-888b6f4a2817-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Acquiring lock "cinder-quobyte-f6d143e9-ecb5-4e90-9787-d623a005aa3c" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-quobyte-f6d143e9-ecb5-4e90-9787-d623a005aa3c" acquired by "delete_snapshot" :: waited 0.086s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Acquiring lock "cinder-quobyte-9b58d4f1-d783-4e56-a024-888b6f4a2817" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Flow 'volume_create_manager' (f4d48432-c28b-47f2-aa18-c94a994a8f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef505ddc-da5a-459c-9c26-96b8bf9eb539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-quobyte-9b58d4f1-d783-4e56-a024-888b6f4a2817" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Deleting offline snapshot 9b58d4f1-d783-4e56-a024-888b6f4a2817 of volume f6d143e9-ecb5-4e90-9787-d623a005aa3c {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] snapshot_file for this snap is: volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef505ddc-da5a-459c-9c26-96b8bf9eb539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1210347816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d385cd1-805c-4265-9610-5554fed57896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c93e08cc934438a92b0bab3dc3d94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:29Z,use_quota=True,user_id='bea19e0d4151439eac2ff30e9b49f62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4702bb1c-cbb0-47c6-9e44-89aa81ded9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:29 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4702bb1c-cbb0-47c6-9e44-89aa81ded9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e3eaf9-362b-4a3a-b98a-9285dadec429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e3eaf9-362b-4a3a-b98a-9285dadec429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d385cd1-805c-4265-9610-5554fed57896', 'volume_name': 'volume-3d385cd1-805c-4265-9610-5554fed57896', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356c207e-7901-4b6d-abf0-8d1f098dfe34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356c207e-7901-4b6d-abf0-8d1f098dfe34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375b2925-fb13-4a87-a320-b51a00f5bb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:29 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Volume 3d385cd1-805c-4265-9610-5554fed57896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d385cd1-805c-4265-9610-5554fed57896', 'volume_size': 1} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3567b2c9-80eb-453c-87d5-163f456114ed]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-00015507-c816-4243-a0ee-22dcbda7d6a1" returned: 0 in 0.360s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.385s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbd5345-fd92-4847-b6f8-9a328b9a5380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00015507-c816-4243-a0ee-22dcbda7d6a1', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3381478-f55e-4204-8715-09b1c662a5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] Creating offline snapshot f9a61fde-46cf-4e2c-901c-9fef9b841212 of volume bf069de1-c277-4d04-bd2b-f87ab1ad5f9e {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:12:29 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Volume volume-00015507-c816-4243-a0ee-22dcbda7d6a1 (00015507-c816-4243-a0ee-22dcbda7d6a1): created successfully Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3381478-f55e-4204-8715-09b1c662a5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Flow 'volume_create_manager' (df8ba1bf-039d-4567-ac78-f43c95bb493d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9550dd-e9ec-418d-985a-3fb478df252b]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:29 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-46adf3b9-04bf-4e12-964b-17b9a8f0544f tempest-VolumesGetTest-1604525800 None] Created volume successfully. Sep 28 17:12:29 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817 Sep 28 17:12:29 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:29 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e Sep 28 17:12:29 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:30 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817" returned: 0 in 0.505s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad5f579-a5d9-40dd-a9cb-6ad30e91e2da]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:30 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e" returned: 0 in 0.496s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] Acquiring lock "cinder-00015507-c816-4243-a0ee-22dcbda7d6a1-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:30 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 1G Sep 28 17:12:30 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] Lock "cinder-00015507-c816-4243-a0ee-22dcbda7d6a1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] Acquiring lock "cinder-quobyte-00015507-c816-4243-a0ee-22dcbda7d6a1" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-00015507-c816-4243-a0ee-22dcbda7d6a1" acquired by "delete_volume" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27c4594-4548-42c1-9d41-5080e7ae36d2]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-00015507-c816-4243-a0ee-22dcbda7d6a1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:30 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 Sep 28 17:12:30 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:30 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-00015507-c816-4243-a0ee-22dcbda7d6a1 Sep 28 17:12:30 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:30 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3" returned: 0 in 0.569s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:30 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 1G" returned: 0 in 0.579s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:30 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817 Sep 28 17:12:30 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:30 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 Sep 28 17:12:30 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:30 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-00015507-c816-4243-a0ee-22dcbda7d6a1" returned: 0 in 0.511s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-00015507-c816-4243-a0ee-22dcbda7d6a1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:30 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-00015507-c816-4243-a0ee-22dcbda7d6a1 Sep 28 17:12:30 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:31 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212" returned: 0 in 0.352s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:31 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 is being set with open permissions: ugo+rw Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:31 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 Sep 28 17:12:31 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:31 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-00015507-c816-4243-a0ee-22dcbda7d6a1" returned: 0 in 0.319s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-00015507-c816-4243-a0ee-22dcbda7d6a1" released by "delete_volume" :: held 0.891s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] Created reservations ['84dc2ecc-9874-47cd-bcf5-7273c7e41f69', '02dc68b8-f3d7-4666-b9d1-8009b6eedd7f', 'c80c99f0-e6fd-4a8e-b975-80031ab2a2fc', '2f870e25-9392-443e-bcf6-b53607cb1d92'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:31 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817" returned: 0 in 0.638s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:31 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817 Sep 28 17:12:31 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:31 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212" returned: 0 in 0.378s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:31 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:12:31 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:31 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.info Sep 28 17:12:31 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] Acquiring lock "cinder-9ac3df5f-5b70-4f91-ba10-fbc3258b924b-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] Lock "cinder-9ac3df5f-5b70-4f91-ba10-fbc3258b924b-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] Acquiring lock "cinder-quobyte-9ac3df5f-5b70-4f91-ba10-fbc3258b924b" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-9ac3df5f-5b70-4f91-ba10-fbc3258b924b" acquired by "delete_volume" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eba3d33-1973-4f50-8248-27bff59c7c75]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ac3df5f-5b70-4f91-ba10-fbc3258b924b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:31 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.9b58d4f1-d783-4e56-a024-888b6f4a2817" returned: 0 in 0.486s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:31 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.info" returned: 0 in 0.350s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:31 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.info is being set with open permissions: ugo+rw Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:31 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-quobyte-9b58d4f1-d783-4e56-a024-888b6f4a2817" released by "_delete_snapshot" :: held 2.410s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.467s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-quobyte-f6d143e9-ecb5-4e90-9787-d623a005aa3c" released by "delete_snapshot" :: held 2.490s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:31 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.info Sep 28 17:12:31 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:31 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] Deleted volume successfully. Sep 28 17:12:31 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ac3df5f-5b70-4f91-ba10-fbc3258b924b Sep 28 17:12:31 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6a349370-2fce-4f90-aa48-e8ad73c05b44 tempest-VolumesGetTest-1604525800 None] Lock "cinder-00015507-c816-4243-a0ee-22dcbda7d6a1-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Created reservations ['69aa0796-a919-42c2-b2b6-e9a4713d7868', '6411955a-52c9-4b2c-9166-15b5703b1e65', 'c4dfe9a4-a059-4fd8-b7d5-d894a046a92d', 'e71d5775-0d91-4516-a07c-db709db3d9d2'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:32 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Delete snapshot completed successfully. Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-118abb1a-8878-4713-9740-78daa3ca9059 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-9b58d4f1-d783-4e56-a024-888b6f4a2817-delete_snapshot" released by "delete_snapshot" :: held 2.889s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:32 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ac3df5f-5b70-4f91-ba10-fbc3258b924b" returned: 0 in 0.486s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ac3df5f-5b70-4f91-ba10-fbc3258b924b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:32 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.info" returned: 0 in 0.427s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:32 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ac3df5f-5b70-4f91-ba10-fbc3258b924b Sep 28 17:12:32 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.735s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.758s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1210347816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d385cd1-805c-4265-9610-5554fed57896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c93e08cc934438a92b0bab3dc3d94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:29Z,use_quota=True,user_id='bea19e0d4151439eac2ff30e9b49f62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Creating volume 3d385cd1-805c-4265-9610-5554fed57896 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:32 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d385cd1-805c-4265-9610-5554fed57896 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:32 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d385cd1-805c-4265-9610-5554fed57896 1073741824 Sep 28 17:12:32 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:32 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-c687393a-20c2-4831-9e50-c347d8e32a26 tempest-VolumesDeleteCascade-1970734814 None] Create snapshot completed successfully Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Acquiring lock "cinder-65a4e8a6-fb34-433e-890f-ada1caa11cb3-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-65a4e8a6-fb34-433e-890f-ada1caa11cb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Acquiring lock "cinder-quobyte-f6d143e9-ecb5-4e90-9787-d623a005aa3c" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-quobyte-f6d143e9-ecb5-4e90-9787-d623a005aa3c" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Acquiring lock "cinder-quobyte-65a4e8a6-fb34-433e-890f-ada1caa11cb3" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-quobyte-65a4e8a6-fb34-433e-890f-ada1caa11cb3" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:32 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Deleting offline snapshot 65a4e8a6-fb34-433e-890f-ada1caa11cb3 of volume f6d143e9-ecb5-4e90-9787-d623a005aa3c {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] snapshot_file for this snap is: volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ac3df5f-5b70-4f91-ba10-fbc3258b924b" returned: 0 in 0.386s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[349f12ce-206a-4597-99d6-6ae739a5e377]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-9ac3df5f-5b70-4f91-ba10-fbc3258b924b" released by "delete_volume" :: held 0.945s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=134,cinder:UPDATE=156,cinder:DELETE=16,cinder:INSERT=38 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] Created reservations ['44ad75ff-0326-48a8-b1cb-5c71cc55c261', '2b6c714b-f275-41b6-8644-cf05df1ec8ab', '0f46f7c9-fdfc-4b7e-95c9-61d7503e54d1', '318077f4-4836-43b7-b62c-989734c3e570'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:UPDATE=161,cinder:INSERT=37,cinder:SELECT=120,cinder:DELETE=12 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:12:32 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 Sep 28 17:12:32 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:32 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:12:32 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:33 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d385cd1-805c-4265-9610-5554fed57896 1073741824" returned: 0 in 0.693s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d385cd1-805c-4265-9610-5554fed57896 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:33 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d385cd1-805c-4265-9610-5554fed57896 Sep 28 17:12:33 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:33 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3" returned: 0 in 0.503s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf04d2e-c4fc-479f-965c-90f3bb4444c4]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:33 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.356s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:33 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] Deleted volume successfully. Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a34a5b24-3ea4-4e84-bd76-81350e5299d9 tempest-VolumesGetTest-1604525800 None] Lock "cinder-9ac3df5f-5b70-4f91-ba10-fbc3258b924b-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:33 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 Sep 28 17:12:33 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:33 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d385cd1-805c-4265-9610-5554fed57896" returned: 0 in 0.321s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375b2925-fb13-4a87-a320-b51a00f5bb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d385cd1-805c-4265-9610-5554fed57896', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c2b9b9-a312-4c45-bcbc-f43f4d2943f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:33 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Volume volume-3d385cd1-805c-4265-9610-5554fed57896 (3d385cd1-805c-4265-9610-5554fed57896): created successfully Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c2b9b9-a312-4c45-bcbc-f43f4d2943f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Flow 'volume_create_manager' (f4d48432-c28b-47f2-aa18-c94a994a8f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:33 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-e9a186db-240b-4d5f-9131-994c2ec98c56 tempest-VolumesMetadataTest-1043372615 None] Created volume successfully. Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c1d02b2d-d971-465b-aacd-5e43c68da53b tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c1d02b2d-d971-465b-aacd-5e43c68da53b tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-c1d02b2d-d971-465b-aacd-5e43c68da53b tempest-VolumesDeleteCascade-1970734814 None] Creating offline snapshot 715658e1-32fd-4c6a-a34b-e4d5be0426f4 of volume bf069de1-c277-4d04-bd2b-f87ab1ad5f9e {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:12:33 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21" returned: 0 in 0.496s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a65950-7f1c-45db-a472-52fee5f16313]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c1d02b2d-d971-465b-aacd-5e43c68da53b tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:33 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 Sep 28 17:12:33 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:33 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 Sep 28 17:12:33 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:34 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c1d02b2d-d971-465b-aacd-5e43c68da53b tempest-VolumesDeleteCascade-1970734814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212" returned: 0 in 0.607s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:34 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-c1d02b2d-d971-465b-aacd-5e43c68da53b tempest-VolumesDeleteCascade-1970734814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c1d02b2d-d971-465b-aacd-5e43c68da53b tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:34 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3" returned: 0 in 0.641s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:34 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4 1G Sep 28 17:12:34 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:34 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3 Sep 28 17:12:34 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:34 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.65a4e8a6-fb34-433e-890f-ada1caa11cb3" returned: 0 in 0.486s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-quobyte-65a4e8a6-fb34-433e-890f-ada1caa11cb3" released by "_delete_snapshot" :: held 2.284s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-quobyte-f6d143e9-ecb5-4e90-9787-d623a005aa3c" released by "delete_snapshot" :: held 2.319s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] Acquiring lock "cinder-3d385cd1-805c-4265-9610-5554fed57896-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Flow 'volume_create_manager' (ea40da23-c936-4b74-ab99-f126a5beb31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a8d52a-72b8-4fb3-867d-be28629f1556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] Lock "cinder-3d385cd1-805c-4265-9610-5554fed57896-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:35 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a8d52a-72b8-4fb3-867d-be28629f1556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1476317624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ffe6f3-0f72-43ff-b853-0cb6889dc5b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac3176978694ef49aeed5083a9b17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:35Z,use_quota=True,user_id='7054348844054a8d8d1254e8645685f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb1b684-9b4c-4e65-83f6-9f9bc1050544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb1b684-9b4c-4e65-83f6-9f9bc1050544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178d27f0-82fb-4a6e-a0c0-aa04d6754588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178d27f0-82fb-4a6e-a0c0-aa04d6754588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99ffe6f3-0f72-43ff-b853-0cb6889dc5b5', 'volume_name': 'volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce18de8c-fbfc-47aa-80bc-e70025fd5836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce18de8c-fbfc-47aa-80bc-e70025fd5836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26f6ed5-d51f-4f2a-a834-e6129180b9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:35 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Volume 99ffe6f3-0f72-43ff-b853-0cb6889dc5b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5', 'volume_size': 1} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c1d02b2d-d971-465b-aacd-5e43c68da53b tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4 1G" returned: 0 in 0.844s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c1d02b2d-d971-465b-aacd-5e43c68da53b tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Created reservations ['ce7cda7d-3f39-416e-86d0-a7f7acc4929a', '1b3d9e77-a28d-4fce-bd30-2e4694554844', '9b67325e-605e-4e11-87c5-99cb5454c7aa', 'ed8fc2ca-c3c7-4561-a8de-382d343e8471'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:35 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4 Sep 28 17:12:35 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] Acquiring lock "cinder-quobyte-3d385cd1-805c-4265-9610-5554fed57896" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] Lock "cinder-quobyte-3d385cd1-805c-4265-9610-5554fed57896" acquired by "delete_volume" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[299fb583-d8de-409e-99de-4539afd2bf7d]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d385cd1-805c-4265-9610-5554fed57896 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:35 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Delete snapshot completed successfully. Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4a880c7f-8f1e-42b1-a32d-0c9f0361ac90 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-65a4e8a6-fb34-433e-890f-ada1caa11cb3-delete_snapshot" released by "delete_snapshot" :: held 2.803s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:35 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d385cd1-805c-4265-9610-5554fed57896 Sep 28 17:12:35 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:35 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c1d02b2d-d971-465b-aacd-5e43c68da53b tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4" returned: 0 in 0.376s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:35 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-c1d02b2d-d971-465b-aacd-5e43c68da53b tempest-VolumesDeleteCascade-1970734814 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4 is being set with open permissions: ugo+rw Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c1d02b2d-d971-465b-aacd-5e43c68da53b tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:35 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4 Sep 28 17:12:35 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:35 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d385cd1-805c-4265-9610-5554fed57896" returned: 0 in 0.472s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d385cd1-805c-4265-9610-5554fed57896 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:35 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d385cd1-805c-4265-9610-5554fed57896 Sep 28 17:12:35 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] Acquiring lock "cinder-c10c1895-e030-4806-b9e1-16de468d1f21-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-c10c1895-e030-4806-b9e1-16de468d1f21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] Acquiring lock "cinder-quobyte-f6d143e9-ecb5-4e90-9787-d623a005aa3c" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-quobyte-f6d143e9-ecb5-4e90-9787-d623a005aa3c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] Acquiring lock "cinder-quobyte-c10c1895-e030-4806-b9e1-16de468d1f21" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-quobyte-c10c1895-e030-4806-b9e1-16de468d1f21" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] Deleting offline snapshot c10c1895-e030-4806-b9e1-16de468d1f21 of volume f6d143e9-ecb5-4e90-9787-d623a005aa3c {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:12:35 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] snapshot_file for this snap is: volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:12:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c1d02b2d-d971-465b-aacd-5e43c68da53b tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4" returned: 0 in 0.411s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c1d02b2d-d971-465b-aacd-5e43c68da53b tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.400s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[918bfd60-2c1b-477d-b115-ce9abcef4fbb]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.859s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1476317624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ffe6f3-0f72-43ff-b853-0cb6889dc5b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac3176978694ef49aeed5083a9b17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:35Z,use_quota=True,user_id='7054348844054a8d8d1254e8645685f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Creating volume 99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:36 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:36 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 1073741824 Sep 28 17:12:36 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:36 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-c1d02b2d-d971-465b-aacd-5e43c68da53b tempest-VolumesDeleteCascade-1970734814 None] Create snapshot completed successfully Sep 28 17:12:36 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d385cd1-805c-4265-9610-5554fed57896" returned: 0 in 0.369s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] Lock "cinder-quobyte-3d385cd1-805c-4265-9610-5554fed57896" released by "delete_volume" :: held 0.919s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:36 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 Sep 28 17:12:36 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] Created reservations ['d6b37f22-81c6-4537-ac21-6dadc61056af', '8b91691f-05e4-4ceb-b5b9-1c66d39a9d8d', '2c945794-6504-4205-a59f-c3187357c56c', 'a921a67e-6d83-438e-b2fd-7beec7a06f07'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:36 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:12:36 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:36 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21" returned: 0 in 0.566s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91e4205-2b9e-4926-8c4c-681d57c25903]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:36 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 1073741824" returned: 0 in 0.701s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:36 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:36 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c Sep 28 17:12:36 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.371s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:36 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] Deleted volume successfully. Sep 28 17:12:36 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 Sep 28 17:12:36 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4fb707b5-3023-492e-99ed-42220340d7bc tempest-VolumesMetadataTest-1043372615 None] Lock "cinder-3d385cd1-805c-4265-9610-5554fed57896-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "cinder-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Performing cascade delete. {{(pid=86970) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "cinder-715658e1-32fd-4c6a-a34b-e4d5be0426f4-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-715658e1-32fd-4c6a-a34b-e4d5be0426f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "cinder-quobyte-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "cinder-quobyte-715658e1-32fd-4c6a-a34b-e4d5be0426f4" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-715658e1-32fd-4c6a-a34b-e4d5be0426f4" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Deleting offline snapshot 715658e1-32fd-4c6a-a34b-e4d5be0426f4 of volume bf069de1-c277-4d04-bd2b-f87ab1ad5f9e {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:12:37 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] snapshot_file for this snap is: volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5" returned: 0 in 0.452s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1c4fe3-bdc1-4e7b-8cf7-349eab719864]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26f6ed5-d51f-4f2a-a834-e6129180b9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:37 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee44fcb7-5b3f-4036-9a89-70fd884caec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c" returned: 0 in 0.650s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:37 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Volume volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 (99ffe6f3-0f72-43ff-b853-0cb6889dc5b5): created successfully Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee44fcb7-5b3f-4036-9a89-70fd884caec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:37 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 Sep 28 17:12:37 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Flow 'volume_create_manager' (ea40da23-c936-4b74-ab99-f126a5beb31f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:37 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-7ee77298-200a-44c4-aa88-25e7af277956 tempest-VolumesGetTest-1604525800 None] Created volume successfully. Sep 28 17:12:37 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4 Sep 28 17:12:37 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:37 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21" returned: 0 in 0.480s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:37 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4" returned: 0 in 0.542s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:37 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21 Sep 28 17:12:37 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4fa316-912a-4a96-86b3-9af74478e148]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:37 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 Sep 28 17:12:37 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:38 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c.c10c1895-e030-4806-b9e1-16de468d1f21" returned: 0 in 0.343s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-quobyte-c10c1895-e030-4806-b9e1-16de468d1f21" released by "_delete_snapshot" :: held 2.261s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-quobyte-f6d143e9-ecb5-4e90-9787-d623a005aa3c" released by "delete_snapshot" :: held 2.297s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:38 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] Created reservations ['bc96b308-9dae-4566-80c5-e60e37e2b475', '43eb3c60-4640-42ff-985c-f8f23eb1f233', '948d3ad9-d962-420f-a646-5f6d87cd4c90', '36ed2898-d148-42be-8d33-980bd6b44c02'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:38 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212" returned: 0 in 0.487s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:38 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4 Sep 28 17:12:38 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:38 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] Delete snapshot completed successfully. Sep 28 17:12:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d37e321b-7a88-418f-bde9-36ff0b85ea1c tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-c10c1895-e030-4806-b9e1-16de468d1f21-delete_snapshot" released by "delete_snapshot" :: held 2.532s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:38 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4" returned: 0 in 0.603s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:38 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4 Sep 28 17:12:38 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Flow 'volume_create_manager' (9372892c-5360-4fdc-acd9-26f4348dc4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b39e73e-3227-4336-9c25-ef9bf3af61f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b39e73e-3227-4336-9c25-ef9bf3af61f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-447116564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818f7777-77e1-46b8-862f-b4b659923391,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='aac3176978694ef49aeed5083a9b17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=99ffe6f3-0f72-43ff-b853-0cb6889dc5b5,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:39Z,use_quota=True,user_id='7054348844054a8d8d1254e8645685f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1648a0a4-5655-4b19-9c69-48885b4c0498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1648a0a4-5655-4b19-9c69-48885b4c0498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78beb1e4-2d04-45f5-9289-9d434345fc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78beb1e4-2d04-45f5-9289-9d434345fc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '818f7777-77e1-46b8-862f-b4b659923391', 'volume_name': 'volume-818f7777-77e1-46b8-862f-b4b659923391', 'volume_size': 1, 'source_volid': '99ffe6f3-0f72-43ff-b853-0cb6889dc5b5', 'source_volstatus': 'available'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f9f334-d2af-43c3-89ee-670b43432b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:39 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f9f334-d2af-43c3-89ee-670b43432b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c5f5bd-7946-44ec-9c7a-b24485d99210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:39 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Volume 818f7777-77e1-46b8-862f-b4b659923391: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-818f7777-77e1-46b8-862f-b4b659923391', 'volume_size': 1, 'source_volid': '99ffe6f3-0f72-43ff-b853-0cb6889dc5b5', 'source_volstatus': 'available'} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.715658e1-32fd-4c6a-a34b-e4d5be0426f4" returned: 0 in 0.372s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:39 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Cloning volume 99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 to volume 818f7777-77e1-46b8-862f-b4b659923391 Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-715658e1-32fd-4c6a-a34b-e4d5be0426f4" released by "_delete_snapshot" :: held 2.196s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e" released by "delete_snapshot" :: held 2.246s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Creating offline snapshot 471bf570-de52-424c-8b7d-04dd6343f20a of volume 99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[003f0667-341e-41cd-a05d-4be1868a9d5d]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] Acquiring lock "cinder-f6d143e9-ecb5-4e90-9787-d623a005aa3c-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-f6d143e9-ecb5-4e90-9787-d623a005aa3c-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Created reservations ['f77a6b7a-ade1-4334-8eb7-184d2db46750', '1a28eb98-e417-4655-9d5d-7f1d7c0cab41', '196cffa4-c810-41d0-b31e-3e98dff5d982', 'c396568e-b24d-4d7e-9dfc-9a4a226e492f'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] Acquiring lock "cinder-quobyte-f6d143e9-ecb5-4e90-9787-d623a005aa3c" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:39 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 Sep 28 17:12:39 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-quobyte-f6d143e9-ecb5-4e90-9787-d623a005aa3c" acquired by "delete_volume" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccd6cc9-a5a4-4f83-8142-47d8a4e6ff55]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:39 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Delete snapshot completed successfully. Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-715658e1-32fd-4c6a-a34b-e4d5be0426f4-delete_snapshot" released by "delete_snapshot" :: held 2.651s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "cinder-f9a61fde-46cf-4e2c-901c-9fef9b841212-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-f9a61fde-46cf-4e2c-901c-9fef9b841212-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "cinder-quobyte-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "cinder-quobyte-f9a61fde-46cf-4e2c-901c-9fef9b841212" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-f9a61fde-46cf-4e2c-901c-9fef9b841212" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Deleting offline snapshot f9a61fde-46cf-4e2c-901c-9fef9b841212 of volume bf069de1-c277-4d04-bd2b-f87ab1ad5f9e {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] snapshot_file for this snap is: volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:12:39 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c Sep 28 17:12:39 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef20e1a2-b166-43c4-888a-f71a996c9c7f]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:40 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 Sep 28 17:12:40 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:40 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5" returned: 0 in 0.625s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:40 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a 1G Sep 28 17:12:40 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:40 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c" returned: 0 in 0.476s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:40 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c Sep 28 17:12:40 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:40 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212" returned: 0 in 0.508s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0e753d-230e-4481-912f-18ba7445d1b0]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:40 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f6d143e9-ecb5-4e90-9787-d623a005aa3c" returned: 0 in 0.345s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-quobyte-f6d143e9-ecb5-4e90-9787-d623a005aa3c" released by "delete_volume" :: held 0.908s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:40 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e Sep 28 17:12:40 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] Created reservations ['da2ec21e-b22b-4c8f-8906-5b441e979cbc', '103bc913-8412-4064-a1d4-50934369fe44', '81dda186-6748-4113-aa79-9bc470c6ef7a', '9bf1dfb5-b1fd-437e-88a6-6fbb20dc35e7'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:40 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a 1G" returned: 0 in 0.581s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:40 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a Sep 28 17:12:40 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:40 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:12:40 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:41 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e" returned: 0 in 0.524s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:41 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 Sep 28 17:12:41 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:41 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a" returned: 0 in 0.428s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:41 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a is being set with open permissions: ugo+rw Sep 28 17:12:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:41 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:41 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a Sep 28 17:12:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.370s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:41 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:41 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:41 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] Deleted volume successfully. Sep 28 17:12:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42517571-9bed-45a8-9929-81046045c660 tempest-VolumesSnapshotListTestJSON-1166373603 None] Lock "cinder-f6d143e9-ecb5-4e90-9787-d623a005aa3c-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:41 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a" returned: 0 in 0.370s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:41 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212" returned: 0 in 0.538s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:41 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.info Sep 28 17:12:41 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:41 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212 Sep 28 17:12:41 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:41 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.info" returned: 0 in 0.303s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:41 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.info is being set with open permissions: ugo+rw Sep 28 17:12:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:41 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e.f9a61fde-46cf-4e2c-901c-9fef9b841212" returned: 0 in 0.301s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:41 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.info Sep 28 17:12:41 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-f9a61fde-46cf-4e2c-901c-9fef9b841212" released by "_delete_snapshot" :: held 2.030s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e" released by "delete_snapshot" :: held 2.060s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:41 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Created reservations ['ca358416-1781-44d0-be38-a1189b44dd90', '3509b4d5-2a49-4a6e-8244-64c275f01e17', '1b4d496e-b120-42ec-8c77-be1186f91fcb', '2d3ba6a1-ec6e-467f-a4de-aa40619c6352'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:42 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Delete snapshot completed successfully. Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-f9a61fde-46cf-4e2c-901c-9fef9b841212-delete_snapshot" released by "delete_snapshot" :: held 2.278s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Snapshots deleted, issuing volume delete {{(pid=86970) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "cinder-quobyte-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e" acquired by "delete_volume" :: waited 0.035s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:42 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.info" returned: 0 in 0.352s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Acquiring lock "cinder-quobyte-818f7777-77e1-46b8-862f-b4b659923391" by "_copy_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb6837c-d46b-4d5d-86ad-a9820f5badcc]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-818f7777-77e1-46b8-862f-b4b659923391" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] snapshot: 471bf570-de52-424c-8b7d-04dd6343f20a, volume: 818f7777-77e1-46b8-862f-b4b659923391, {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e397ad8-abd3-4ca9-b1ce-1b2150769f89]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:42 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e Sep 28 17:12:42 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:42 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a Sep 28 17:12:42 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:42 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e" returned: 0 in 0.531s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:42 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e Sep 28 17:12:42 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:42 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a" returned: 0 in 0.519s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[e439487d-cfc5-4746-9553-80a6dd125914]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:42 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 Sep 28 17:12:42 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:43 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e" returned: 0 in 0.409s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e" released by "delete_volume" :: held 1.057s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:43 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Created reservations ['2c808764-2dba-4317-8f76-b4fbfaf945f2', '67ecc61d-7542-4f8b-be9a-52edfaf585a9', 'c858aa55-576e-4353-ad17-166697393d4a', '2eb0fdac-7b10-4bd9-874d-d4871f3b1892'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:43 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5" returned: 0 in 0.523s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:12:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Creating direct copy from snapshot {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:12:43 devstack cinder-volume[86970]: DEBUG cinder.utils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Path /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-818f7777-77e1-46b8-862f-b4b659923391 not found in is_blk_device check {{(pid=86970) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:12:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-818f7777-77e1-46b8-862f-b4b659923391 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:43 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-818f7777-77e1-46b8-862f-b4b659923391 Sep 28 17:12:43 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:43 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:12:43 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:43 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.378s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:43 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:43 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Deleted volume successfully. Sep 28 17:12:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-697073bb-5de4-49a5-b776-3b5d04b03723 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-bf069de1-c277-4d04-bd2b-f87ab1ad5f9e-delete_volume" released by "delete_volume" :: held 6.948s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:45 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Flow 'volume_create_manager' (3ddcf42f-5c47-47d2-9564-be1a97e1b58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a604329f-3c1a-4d4b-88e3-e0ab5f32a7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a604329f-3c1a-4d4b-88e3-e0ab5f32a7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1574547566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585fb252-ceec-4f6e-ac94-73359eec6601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bbfdc5725347ddbd9edea4b875d5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:46Z,use_quota=True,user_id='50acf5825d1e4408a4c1acc53f7ed4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46f84f0-f15f-49af-8a47-b4c5ede6e35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46f84f0-f15f-49af-8a47-b4c5ede6e35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173bf24c-ca39-478a-9311-2e7f64ad3d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173bf24c-ca39-478a-9311-2e7f64ad3d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '585fb252-ceec-4f6e-ac94-73359eec6601', 'volume_name': 'volume-585fb252-ceec-4f6e-ac94-73359eec6601', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b83d41d-5b89-4610-b25e-77f484ddeeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b83d41d-5b89-4610-b25e-77f484ddeeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ae02a5-0540-4181-bbfb-743a43688d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:46 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Volume 585fb252-ceec-4f6e-ac94-73359eec6601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-585fb252-ceec-4f6e-ac94-73359eec6601', 'volume_size': 1} Sep 28 17:12:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:52 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-818f7777-77e1-46b8-862f-b4b659923391" returned: 0 in 9.285s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:52 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Image conversion details: src /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5, size 1024.00 MB, duration 9.29 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-818f7777-77e1-46b8-862f-b4b659923391 {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:12:52 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Converted 1024.00 MB image at 110.27 MB/s Sep 28 17:12:52 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-818f7777-77e1-46b8-862f-b4b659923391 is being set with open permissions: ugo+rw Sep 28 17:12:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-818f7777-77e1-46b8-862f-b4b659923391 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:52 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-818f7777-77e1-46b8-862f-b4b659923391 Sep 28 17:12:52 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:53 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-818f7777-77e1-46b8-862f-b4b659923391" returned: 0 in 0.355s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-818f7777-77e1-46b8-862f-b4b659923391" released by "_copy_volume_from_snapshot" :: held 10.804s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Acquiring lock "cinder-quobyte-471bf570-de52-424c-8b7d-04dd6343f20a" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-471bf570-de52-424c-8b7d-04dd6343f20a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Deleting offline snapshot 471bf570-de52-424c-8b7d-04dd6343f20a of volume 99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:12:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] snapshot_file for this snap is: volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:12:53 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[c767a4f8-cb8c-4820-bc2c-e87694195808]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:53 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a Sep 28 17:12:53 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:53 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a" returned: 0 in 0.453s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:53 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[9647ac04-6a19-422a-a4fc-78510b47e17f]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:53 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 Sep 28 17:12:53 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:54 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5" returned: 0 in 0.727s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:54 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a Sep 28 17:12:54 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:54 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a" returned: 0 in 0.523s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:54 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a Sep 28 17:12:54 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:55 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5.471bf570-de52-424c-8b7d-04dd6343f20a" returned: 0 in 0.411s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-471bf570-de52-424c-8b7d-04dd6343f20a" released by "_delete_snapshot" :: held 2.244s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.021s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.133s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1574547566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585fb252-ceec-4f6e-ac94-73359eec6601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bbfdc5725347ddbd9edea4b875d5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:46Z,use_quota=True,user_id='50acf5825d1e4408a4c1acc53f7ed4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Creating volume 585fb252-ceec-4f6e-ac94-73359eec6601 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:55 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:12:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:55 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 1073741824 Sep 28 17:12:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c5f5bd-7946-44ec-9c7a-b24485d99210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-818f7777-77e1-46b8-862f-b4b659923391', 'volume_size': 1, 'source_volid': '99ffe6f3-0f72-43ff-b853-0cb6889dc5b5', 'source_volstatus': 'available'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:55 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0d0e8c-6aad-4cda-9f1d-d726fed29b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:55 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Volume volume-818f7777-77e1-46b8-862f-b4b659923391 (818f7777-77e1-46b8-862f-b4b659923391): created successfully Sep 28 17:12:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0d0e8c-6aad-4cda-9f1d-d726fed29b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Flow 'volume_create_manager' (9372892c-5360-4fdc-acd9-26f4348dc4eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:55 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3858dd52-7959-4dcf-93e5-46d294ba5ad7 tempest-VolumesGetTest-1604525800 None] Created volume successfully. Sep 28 17:12:56 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 1073741824" returned: 0 in 0.668s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:56 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 Sep 28 17:12:56 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:56 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601" returned: 0 in 0.323s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ae02a5-0540-4181-bbfb-743a43688d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585fb252-ceec-4f6e-ac94-73359eec6601', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f3eb0f-741a-4da4-8dcc-8209bc1c75fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:56 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Volume volume-585fb252-ceec-4f6e-ac94-73359eec6601 (585fb252-ceec-4f6e-ac94-73359eec6601): created successfully Sep 28 17:12:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f3eb0f-741a-4da4-8dcc-8209bc1c75fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Flow 'volume_create_manager' (3ddcf42f-5c47-47d2-9564-be1a97e1b58c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:56 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-57c2adea-eb8a-4327-815c-fd0e8bb84584 tempest-VolumesDeleteCascade-1970734814 None] Created volume successfully. Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Flow 'volume_create_manager' (d11b77e2-d281-4cad-be34-1c193c9c82e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f0bd0a-d86d-41d8-9591-97cec0e2c4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f0bd0a-d86d-41d8-9591-97cec0e2c4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-81513868',display_name='tempest-VolumesGetTest-Volume-458288146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=019d2b43-22cd-4512-b352-d4eb310393f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac3176978694ef49aeed5083a9b17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:57Z,use_quota=True,user_id='7054348844054a8d8d1254e8645685f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4988ea56-2fa1-454b-bc2e-0df4ad0d2f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4988ea56-2fa1-454b-bc2e-0df4ad0d2f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4056ad0a-e4b1-4b52-84e9-e6d76d73b96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4056ad0a-e4b1-4b52-84e9-e6d76d73b96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '019d2b43-22cd-4512-b352-d4eb310393f6', 'volume_name': 'volume-019d2b43-22cd-4512-b352-d4eb310393f6', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1effcd7d-e77f-4021-9916-496b7d4bed7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1effcd7d-e77f-4021-9916-496b7d4bed7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87cfd3e-aafc-47f3-b394-435611d5de26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:57 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Volume 019d2b43-22cd-4512-b352-d4eb310393f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-019d2b43-22cd-4512-b352-d4eb310393f6', 'volume_size': 1} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-81513868',display_name='tempest-VolumesGetTest-Volume-458288146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=019d2b43-22cd-4512-b352-d4eb310393f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac3176978694ef49aeed5083a9b17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:57Z,use_quota=True,user_id='7054348844054a8d8d1254e8645685f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Creating volume 019d2b43-22cd-4512-b352-d4eb310393f6 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:57 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-019d2b43-22cd-4512-b352-d4eb310393f6 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:57 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-019d2b43-22cd-4512-b352-d4eb310393f6 1073741824 Sep 28 17:12:57 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:58 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-019d2b43-22cd-4512-b352-d4eb310393f6 1073741824" returned: 0 in 0.783s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-019d2b43-22cd-4512-b352-d4eb310393f6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:58 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-019d2b43-22cd-4512-b352-d4eb310393f6 Sep 28 17:12:58 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:58 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-019d2b43-22cd-4512-b352-d4eb310393f6" returned: 0 in 0.286s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.696s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87cfd3e-aafc-47f3-b394-435611d5de26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-019d2b43-22cd-4512-b352-d4eb310393f6', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c17c619-ef4e-4109-8bb8-16ab17c3dea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] Creating offline snapshot 47da19ee-ae22-4573-b3da-0f90e546b6e1 of volume 585fb252-ceec-4f6e-ac94-73359eec6601 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:12:58 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Volume volume-019d2b43-22cd-4512-b352-d4eb310393f6 (019d2b43-22cd-4512-b352-d4eb310393f6): created successfully Sep 28 17:12:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c17c619-ef4e-4109-8bb8-16ab17c3dea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Flow 'volume_create_manager' (d11b77e2-d281-4cad-be34-1c193c9c82e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:58 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9e9192-adaf-4264-9fe2-ed6b28b60e38]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:58 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3b187328-d01b-4ff2-8369-373f9d5106e2 tempest-VolumesGetTest-1604525800 None] Created volume successfully. Sep 28 17:12:58 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 Sep 28 17:12:58 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:59 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601" returned: 0 in 0.511s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:59 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1 1G Sep 28 17:12:59 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:59 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] Acquiring lock "cinder-019d2b43-22cd-4512-b352-d4eb310393f6-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:59 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] Lock "cinder-019d2b43-22cd-4512-b352-d4eb310393f6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:59 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] Acquiring lock "cinder-quobyte-019d2b43-22cd-4512-b352-d4eb310393f6" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:59 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-019d2b43-22cd-4512-b352-d4eb310393f6" acquired by "delete_volume" :: waited 0.044s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:59 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:59 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[916da528-fd30-41ca-8b0b-49cc6ccc5bd2]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-019d2b43-22cd-4512-b352-d4eb310393f6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1 1G" returned: 0 in 0.779s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-585fb252-ceec-4f6e-ac94-73359eec6601 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:59 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-585fb252-ceec-4f6e-ac94-73359eec6601 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1 Sep 28 17:12:59 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:00 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-019d2b43-22cd-4512-b352-d4eb310393f6 Sep 28 17:13:00 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:00 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-585fb252-ceec-4f6e-ac94-73359eec6601 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1" returned: 0 in 0.491s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:00 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1 is being set with open permissions: ugo+rw Sep 28 17:13:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:00 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1 Sep 28 17:13:00 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:00 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-019d2b43-22cd-4512-b352-d4eb310393f6" returned: 0 in 0.556s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-019d2b43-22cd-4512-b352-d4eb310393f6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:00 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-019d2b43-22cd-4512-b352-d4eb310393f6 Sep 28 17:13:00 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:00 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1" returned: 0 in 0.440s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:00 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-019d2b43-22cd-4512-b352-d4eb310393f6" returned: 0 in 0.502s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:00 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.info Sep 28 17:13:00 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:00 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-019d2b43-22cd-4512-b352-d4eb310393f6" released by "delete_volume" :: held 1.143s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] Created reservations ['3426affe-668f-4880-9dff-22e619e59948', 'c9e88bdb-8602-4dfc-bb53-94888621060f', 'bd5afa7c-93d6-4b81-b3f1-42b9c339af7c', 'd3247631-fbb1-4648-b8fd-aece55815dc5'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:01 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:13:01 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:01 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:13:01 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:01 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.info" returned: 0 in 0.408s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:01 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.info is being set with open permissions: ugo+rw Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:01 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.info Sep 28 17:13:01 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:01 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.481s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:13:01 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.416s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:01 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] Deleted volume successfully. Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-084e16a5-4dde-4865-ba50-25f7a980e1b3 tempest-VolumesGetTest-1604525800 None] Lock "cinder-019d2b43-22cd-4512-b352-d4eb310393f6-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:01 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.info" returned: 0 in 0.561s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.446s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:02 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-079c3678-cab2-46ab-af07-8956307da54b tempest-VolumesDeleteCascade-1970734814 None] Create snapshot completed successfully Sep 28 17:13:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] Acquiring lock "cinder-818f7777-77e1-46b8-862f-b4b659923391-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] Lock "cinder-818f7777-77e1-46b8-862f-b4b659923391-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] Acquiring lock "cinder-quobyte-818f7777-77e1-46b8-862f-b4b659923391" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-818f7777-77e1-46b8-862f-b4b659923391" acquired by "delete_volume" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:02 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[1051ea7e-38e7-4171-bd6b-dcc76ff27469]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-818f7777-77e1-46b8-862f-b4b659923391 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:02 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-818f7777-77e1-46b8-862f-b4b659923391 Sep 28 17:13:02 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:02 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-818f7777-77e1-46b8-862f-b4b659923391" returned: 0 in 0.488s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-818f7777-77e1-46b8-862f-b4b659923391 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:02 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-818f7777-77e1-46b8-862f-b4b659923391 Sep 28 17:13:02 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:03 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-818f7777-77e1-46b8-862f-b4b659923391" returned: 0 in 0.512s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-818f7777-77e1-46b8-862f-b4b659923391" released by "delete_volume" :: held 1.089s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:03 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] Created reservations ['1d6a2d9a-bfcc-4782-9aa6-6e43df4d5bb1', 'db09ba32-ce15-4c91-8c55-89665634970e', 'aadc1f67-6833-4f4b-9070-8a522c42e450', 'cc50ab7d-faef-4deb-9494-da3e3537bc79'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:03 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:13:03 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:04 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.460s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:04 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] Deleted volume successfully. Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-3f14727c-4aa6-4143-b35e-734e1a5fc56a tempest-VolumesGetTest-1604525800 None] Lock "cinder-818f7777-77e1-46b8-862f-b4b659923391-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Flow 'volume_create_manager' (f75d1acc-5860-4bf1-98f8-37ec149c22a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c058505-df0e-4b84-a36f-512a4a5746e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c058505-df0e-4b84-a36f-512a4a5746e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1231945687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=504356de-b230-4bdd-9320-7a874289b6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bbfdc5725347ddbd9edea4b875d5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=47da19ee-ae22-4573-b3da-0f90e546b6e1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:04Z,use_quota=True,user_id='50acf5825d1e4408a4c1acc53f7ed4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b647df-66d2-4bb5-99e4-9c0701b40aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b647df-66d2-4bb5-99e4-9c0701b40aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3769413-f52c-4d5d-ad08-89e564241d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3769413-f52c-4d5d-ad08-89e564241d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '504356de-b230-4bdd-9320-7a874289b6ea', 'volume_name': 'volume-504356de-b230-4bdd-9320-7a874289b6ea', 'volume_size': 1, 'snapshot_id': '47da19ee-ae22-4573-b3da-0f90e546b6e1'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c98b783-2e4f-4393-b03d-e5825b073856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c98b783-2e4f-4393-b03d-e5825b073856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076b3d83-615b-41f2-9971-db6de64ac01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:04 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Volume 504356de-b230-4bdd-9320-7a874289b6ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-504356de-b230-4bdd-9320-7a874289b6ea', 'volume_size': 1, 'snapshot_id': '47da19ee-ae22-4573-b3da-0f90e546b6e1'} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "cinder-quobyte-47da19ee-ae22-4573-b3da-0f90e546b6e1-504356de-b230-4bdd-9320-7a874289b6ea" by "_create_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-47da19ee-ae22-4573-b3da-0f90e546b6e1-504356de-b230-4bdd-9320-7a874289b6ea" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Creating volume 504356de-b230-4bdd-9320-7a874289b6ea from snapshot 47da19ee-ae22-4573-b3da-0f90e546b6e1 {{(pid=86970) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "cinder-quobyte-504356de-b230-4bdd-9320-7a874289b6ea" by "_copy_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-504356de-b230-4bdd-9320-7a874289b6ea" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] snapshot: 47da19ee-ae22-4573-b3da-0f90e546b6e1, volume: 504356de-b230-4bdd-9320-7a874289b6ea, {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[978d8800-4eec-426d-a182-0c4755839a27]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] Acquiring lock "cinder-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] Lock "cinder-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:04 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1 Sep 28 17:13:04 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] Acquiring lock "cinder-quobyte-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5" acquired by "delete_volume" :: waited 0.038s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:05 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2a0dbd-d086-4de2-8388-0e45df6abb3a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:05 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 Sep 28 17:13:05 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:05 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1" returned: 0 in 0.703s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-585fb252-ceec-4f6e-ac94-73359eec6601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:05 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba3f3ce-3661-4376-935b-7bfc2f8b66e7]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:05 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 Sep 28 17:13:05 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:05 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5" returned: 0 in 0.667s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:05 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5 Sep 28 17:13:05 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:06 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:06 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5" returned: 0 in 0.437s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601" returned: 0 in 0.767s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:13:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Creating direct copy from snapshot {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:13:06 devstack cinder-volume[86970]: DEBUG cinder.utils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Path /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-504356de-b230-4bdd-9320-7a874289b6ea not found in is_blk_device check {{(pid=86970) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:13:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-504356de-b230-4bdd-9320-7a874289b6ea {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5" released by "delete_volume" :: held 1.248s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:06 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-504356de-b230-4bdd-9320-7a874289b6ea Sep 28 17:13:06 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:06 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] Created reservations ['fad2a412-757a-4b27-b282-d5a1003fd31b', 'cbe49d2b-6ea8-4298-86cc-caacaa23d731', '2c3b493f-2363-454b-a420-ac5bf5302c31', '46b9e2f3-86d4-4de5-bd75-ce125f019b9f'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:06 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:13:06 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:07 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.432s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:07 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:07 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] Deleted volume successfully. Sep 28 17:13:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a4651af2-e726-429d-9591-ec7a52a421f6 tempest-VolumesGetTest-1604525800 None] Lock "cinder-99ffe6f3-0f72-43ff-b853-0cb6889dc5b5-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:10 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Flow 'volume_create_manager' (d33baa45-851b-431a-9145-5ed089f53278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74bacd2-6a7e-4a69-b727-a08c3c4d8346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74bacd2-6a7e-4a69-b727-a08c3c4d8346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1821508069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=696a3094-13d3-4d13-b43c-73a1dee4cdf3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='aac3176978694ef49aeed5083a9b17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:10Z,use_quota=True,user_id='7054348844054a8d8d1254e8645685f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff76849b-a73b-4f7f-a8bf-e69cdfa8473c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff76849b-a73b-4f7f-a8bf-e69cdfa8473c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910d5af8-e37a-49f0-9b2c-bb60bf2251c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:10 devstack cinder-volume[86970]: DEBUG cinder.image.glance [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Creating Keystone auth plugin from conf {{(pid=86970) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:13:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910d5af8-e37a-49f0-9b2c-bb60bf2251c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '696a3094-13d3-4d13-b43c-73a1dee4cdf3', 'volume_name': 'volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3', 'volume_size': 1, 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '280d624e0a3d44539d88968c5a0e8318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b146e8-5c14-42b3-ada6-7e57c3fad47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b146e8-5c14-42b3-ada6-7e57c3fad47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec70040-bafd-4ae1-976b-21d56cc71568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:11 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Volume 696a3094-13d3-4d13-b43c-73a1dee4cdf3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3', 'volume_size': 1, 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '280d624e0a3d44539d88968c5a0e8318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:13:11 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Trying to clone 696a3094-13d3-4d13-b43c-73a1dee4cdf3 from image d659fbbf-f540-415a-bb1b-8ef207a29f4e at location (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]). {{(pid=86970) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:13:12 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_b66balaodevstack@QuobyteHD, size 20.69 MB, duration 1.03 sec {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:13:12 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Image download 20.69 MB at 20.13 MB/s Sep 28 17:13:12 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ce30bc-fb40-4b7d-b423-40fa01b6b91a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_b66balaodevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:13 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_b66balaodevstack@QuobyteHD Sep 28 17:13:13 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:13 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Flow 'volume_create_manager' (cdbe1016-c998-4ea8-bfa4-b792f88ad9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe577ecb-be70-4bcb-ac79-4ad3146d9583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe577ecb-be70-4bcb-ac79-4ad3146d9583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1853239991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eedc2b38-c9a4-4aa3-b63c-7402268d977c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2165e596dd410eb6640da78bd45a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:13Z,use_quota=True,user_id='69b217116aca432c93cde73cd85e40f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6a5756-a679-4ef4-8889-f701a41b1168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6a5756-a679-4ef4-8889-f701a41b1168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5b0159-d049-4d41-a9bf-cab63e768968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5b0159-d049-4d41-a9bf-cab63e768968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eedc2b38-c9a4-4aa3-b63c-7402268d977c', 'volume_name': 'volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cc8c80-348a-4be1-81f3-60638d1189b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cc8c80-348a-4be1-81f3-60638d1189b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1002b2-72de-4a32-93b0-18cc8f26eaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:13 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Volume eedc2b38-c9a4-4aa3-b63c-7402268d977c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c', 'volume_size': 1} Sep 28 17:13:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:13 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_b66balaodevstack@QuobyteHD" returned: 0 in 0.896s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:13 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Temporary image d659fbbf-f540-415a-bb1b-8ef207a29f4e is fetched for user 7054348844054a8d8d1254e8645685f1. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:13:13 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb581fa-50e9-4cf4-8d02-fd5f593442d0]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_b66balaodevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:14 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_b66balaodevstack@QuobyteHD Sep 28 17:13:14 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:14 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_b66balaodevstack@QuobyteHD" returned: 0 in 0.509s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:16 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-504356de-b230-4bdd-9320-7a874289b6ea" returned: 0 in 10.186s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Image conversion details: src /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601, size 1024.00 MB, duration 10.19 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-504356de-b230-4bdd-9320-7a874289b6ea {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:13:16 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Converted 1024.00 MB image at 100.51 MB/s Sep 28 17:13:16 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-504356de-b230-4bdd-9320-7a874289b6ea is being set with open permissions: ugo+rw Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-504356de-b230-4bdd-9320-7a874289b6ea {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:16 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-504356de-b230-4bdd-9320-7a874289b6ea Sep 28 17:13:16 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:16 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-504356de-b230-4bdd-9320-7a874289b6ea" returned: 0 in 0.296s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-504356de-b230-4bdd-9320-7a874289b6ea" released by "_copy_volume_from_snapshot" :: held 12.118s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-47da19ee-ae22-4573-b3da-0f90e546b6e1-504356de-b230-4bdd-9320-7a874289b6ea" released by "_create_volume_from_snapshot" :: held 12.217s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.244s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.276s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1853239991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eedc2b38-c9a4-4aa3-b63c-7402268d977c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2165e596dd410eb6640da78bd45a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:13Z,use_quota=True,user_id='69b217116aca432c93cde73cd85e40f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Creating volume eedc2b38-c9a4-4aa3-b63c-7402268d977c {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:16 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:16 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c 1073741824 Sep 28 17:13:16 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076b3d83-615b-41f2-9971-db6de64ac01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-504356de-b230-4bdd-9320-7a874289b6ea', 'volume_size': 1, 'snapshot_id': '47da19ee-ae22-4573-b3da-0f90e546b6e1'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:16 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d39684-f506-4326-91d9-bf446d09f177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:16 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Volume volume-504356de-b230-4bdd-9320-7a874289b6ea (504356de-b230-4bdd-9320-7a874289b6ea): created successfully Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d39684-f506-4326-91d9-bf446d09f177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Flow 'volume_create_manager' (f75d1acc-5860-4bf1-98f8-37ec149c22a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:17 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-16ac3332-607e-4767-8f0d-a5290cb57dd7 tempest-VolumesDeleteCascade-1970734814 None] Created volume successfully. Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "cinder-585fb252-ceec-4f6e-ac94-73359eec6601-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-585fb252-ceec-4f6e-ac94-73359eec6601-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:17 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c 1073741824" returned: 0 in 0.645s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Performing cascade delete. {{(pid=86970) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "cinder-47da19ee-ae22-4573-b3da-0f90e546b6e1-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:17 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c Sep 28 17:13:17 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-47da19ee-ae22-4573-b3da-0f90e546b6e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "cinder-quobyte-585fb252-ceec-4f6e-ac94-73359eec6601" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-585fb252-ceec-4f6e-ac94-73359eec6601" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "cinder-quobyte-47da19ee-ae22-4573-b3da-0f90e546b6e1" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-47da19ee-ae22-4573-b3da-0f90e546b6e1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Deleting offline snapshot 47da19ee-ae22-4573-b3da-0f90e546b6e1 of volume 585fb252-ceec-4f6e-ac94-73359eec6601 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] snapshot_file for this snap is: volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47bf25d-46f8-4847-ad1a-c8da364562de]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:17 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1 Sep 28 17:13:17 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:17 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c" returned: 0 in 0.329s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.534s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1821508069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=696a3094-13d3-4d13-b43c-73a1dee4cdf3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='aac3176978694ef49aeed5083a9b17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:10Z,use_quota=True,user_id='7054348844054a8d8d1254e8645685f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Creating volume 696a3094-13d3-4d13-b43c-73a1dee4cdf3 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:17 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1002b2-72de-4a32-93b0-18cc8f26eaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:17 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3 1073741824 Sep 28 17:13:17 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a3ffbb4-2f7d-46bd-a6ab-c63c2b906815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:18 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Volume volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c (eedc2b38-c9a4-4aa3-b63c-7402268d977c): created successfully Sep 28 17:13:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a3ffbb4-2f7d-46bd-a6ab-c63c2b906815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Flow 'volume_create_manager' (cdbe1016-c998-4ea8-bfa4-b792f88ad9b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:18 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-86a1a524-ddb5-4523-8c7f-831286c6f4c4 tempest-VolumesSnapshotTestJSON-717735650 None] Created volume successfully. Sep 28 17:13:18 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1" returned: 0 in 0.561s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-585fb252-ceec-4f6e-ac94-73359eec6601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:18 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0d7f75-ee4e-4986-b9ec-6f1795c71d4d]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:18 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 Sep 28 17:13:18 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:18 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3 1073741824" returned: 0 in 0.730s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:18 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3 Sep 28 17:13:18 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:19 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3" returned: 0 in 0.456s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.033s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:19 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601" returned: 0 in 0.878s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:19 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1 Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] Creating offline snapshot 543087de-2e2f-4c5e-baa6-8ce9dd111ac5 of volume eedc2b38-c9a4-4aa3-b63c-7402268d977c {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:19 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Attempting download of d659fbbf-f540-415a-bb1b-8ef207a29f4e ((None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}])) to volume 696a3094-13d3-4d13-b43c-73a1dee4cdf3. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ba5a2a-a8d6-407f-9962-1a8157670819]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[94425a70-c410-4919-90ab-a01e370f1e64]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_dexia3b8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:19 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c Sep 28 17:13:19 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:19 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_dexia3b8 Sep 28 17:13:19 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:19 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1" returned: 0 in 0.614s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:19 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1 Sep 28 17:13:19 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:19 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_dexia3b8" returned: 0 in 0.645s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_dexia3b8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:19 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c" returned: 0 in 0.721s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:20 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5 1G Sep 28 17:13:20 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:20 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_dexia3b8 Sep 28 17:13:20 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:20 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601.47da19ee-ae22-4573-b3da-0f90e546b6e1" returned: 0 in 0.373s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-47da19ee-ae22-4573-b3da-0f90e546b6e1" released by "_delete_snapshot" :: held 2.562s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-585fb252-ceec-4f6e-ac94-73359eec6601" released by "delete_snapshot" :: held 2.606s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Created reservations ['c239bc4c-676c-477a-80a8-feeaff80eb79', '7fac3037-3661-44a9-ada1-9ec8814134ca', '77e3ca9a-7f06-4185-99dd-72e1a3fd66c9', 'ba0fd919-eb77-458d-8248-de77d4072c95'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:20 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Delete snapshot completed successfully. Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-47da19ee-ae22-4573-b3da-0f90e546b6e1-delete_snapshot" released by "delete_snapshot" :: held 2.881s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Snapshots deleted, issuing volume delete {{(pid=86970) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 17:13:20 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "cinder-quobyte-585fb252-ceec-4f6e-ac94-73359eec6601" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_dexia3b8" returned: 1 in 0.533s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_dexia3b8' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[222b84a9-5972-4d98-a6ca-4539c7211c44]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_b66balaodevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-585fb252-ceec-4f6e-ac94-73359eec6601" acquired by "delete_volume" :: waited 0.052s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d43d73-f2ec-4879-af77-8433792b2776]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:20 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:20 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_b66balaodevstack@QuobyteHD Sep 28 17:13:20 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5 1G" returned: 0 in 0.690s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:20 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5 Sep 28 17:13:20 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:20 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 Sep 28 17:13:20 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:20 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_b66balaodevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] d659fbbf-f540-415a-bb1b-8ef207a29f4e was qcow2, converting to qcow2 {{(pid=86970) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:13:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_b66balaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:21 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_b66balaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3 Sep 28 17:13:21 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:21 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5" returned: 0 in 0.477s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:21 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5 is being set with open permissions: ugo+rw Sep 28 17:13:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:21 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:21 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5 Sep 28 17:13:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601" returned: 0 in 0.613s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:21 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:21 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601 Sep 28 17:13:21 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:21 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5" returned: 0 in 0.456s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:21 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-585fb252-ceec-4f6e-ac94-73359eec6601" returned: 0 in 0.466s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:21 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.info Sep 28 17:13:21 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-585fb252-ceec-4f6e-ac94-73359eec6601" released by "delete_volume" :: held 1.194s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:21 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Created reservations ['2dec2617-3677-4386-a726-1ac10254a24a', '428a1f44-61fd-4578-8e9b-3098eb3ea2c3', '797a53dd-bc8c-4ebf-b0e6-5504c364bcba', 'bae19fb2-13af-48d1-83ed-dfa148d636f1'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:22 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:13:22 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:22 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.info" returned: 0 in 0.457s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:22 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.info is being set with open permissions: ugo+rw Sep 28 17:13:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:22 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.info Sep 28 17:13:22 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "cinder-504356de-b230-4bdd-9320-7a874289b6ea-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:22 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.523s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:22 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:22 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Deleted volume successfully. Sep 28 17:13:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-504356de-b230-4bdd-9320-7a874289b6ea-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b0415570-0f80-43ff-85cc-7f22ad90e6da tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-585fb252-ceec-4f6e-ac94-73359eec6601-delete_volume" released by "delete_volume" :: held 5.097s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "cinder-quobyte-504356de-b230-4bdd-9320-7a874289b6ea" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-504356de-b230-4bdd-9320-7a874289b6ea" acquired by "delete_volume" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:22 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6b23ed-0818-4345-9d19-8fdd56fead35]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-504356de-b230-4bdd-9320-7a874289b6ea {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:22 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.info" returned: 0 in 0.553s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.542s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:22 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-037785c2-c75a-423c-b112-9641434a55c1 tempest-VolumesSnapshotTestJSON-717735650 None] Create snapshot completed successfully Sep 28 17:13:22 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-504356de-b230-4bdd-9320-7a874289b6ea Sep 28 17:13:22 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:23 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-504356de-b230-4bdd-9320-7a874289b6ea" returned: 0 in 0.606s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-504356de-b230-4bdd-9320-7a874289b6ea {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:23 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-504356de-b230-4bdd-9320-7a874289b6ea Sep 28 17:13:23 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:23 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-504356de-b230-4bdd-9320-7a874289b6ea" returned: 0 in 0.441s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-quobyte-504356de-b230-4bdd-9320-7a874289b6ea" released by "delete_volume" :: held 1.123s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-543087de-2e2f-4c5e-baa6-8ce9dd111ac5-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-543087de-2e2f-4c5e-baa6-8ce9dd111ac5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:23 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] Created reservations ['20d7a8f9-844f-4bb8-9bfa-1dc0cec20f43', '3440d53a-600d-4302-aeb2-5e9c556c7d45', '288d6b4c-529d-4b0a-945a-d5481c164a9d', '4e9b8566-6ee8-4328-a33a-98f44f39025f'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-quobyte-eedc2b38-c9a4-4aa3-b63c-7402268d977c" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-eedc2b38-c9a4-4aa3-b63c-7402268d977c" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-quobyte-543087de-2e2f-4c5e-baa6-8ce9dd111ac5" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-543087de-2e2f-4c5e-baa6-8ce9dd111ac5" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] Deleting offline snapshot 543087de-2e2f-4c5e-baa6-8ce9dd111ac5 of volume eedc2b38-c9a4-4aa3-b63c-7402268d977c {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] snapshot_file for this snap is: volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c05bf8-86c9-4cd7-9848-912615e3b46d]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:24 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:13:24 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:24 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_b66balaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3" returned: 0 in 3.256s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_b66balaodevstack@QuobyteHD, size 112.00 MB, duration 3.26 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3 {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:13:24 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Converted 112.00 MB image at 34.38 MB/s Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:24 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3 1G Sep 28 17:13:24 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:24 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5 Sep 28 17:13:24 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:24 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.316s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:24 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] Deleted volume successfully. Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-02ed9ca0-aff4-4e24-9997-3d8371424abe tempest-VolumesDeleteCascade-1970734814 None] Lock "cinder-504356de-b230-4bdd-9320-7a874289b6ea-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:24 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3 1G" returned: 0 in 0.407s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Downloaded image d659fbbf-f540-415a-bb1b-8ef207a29f4e ((None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}])) to volume 696a3094-13d3-4d13-b43c-73a1dee4cdf3 successfully. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Temporary image d659fbbf-f540-415a-bb1b-8ef207a29f4e for user 7054348844054a8d8d1254e8645685f1 is deleted. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Marking volume 696a3094-13d3-4d13-b43c-73a1dee4cdf3 as bootable. {{(pid=86970) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Copying metadata from image d659fbbf-f540-415a-bb1b-8ef207a29f4e to 696a3094-13d3-4d13-b43c-73a1dee4cdf3. {{(pid=86970) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Creating volume glance metadata for volume 696a3094-13d3-4d13-b43c-73a1dee4cdf3 backed by image d659fbbf-f540-415a-bb1b-8ef207a29f4e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86970) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:13:24 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5" returned: 0 in 0.657s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec70040-bafd-4ae1-976b-21d56cc71568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3', 'volume_size': 1, 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '280d624e0a3d44539d88968c5a0e8318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87c4fce-1fac-4c7d-b5fd-f15165789e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[e030b3be-8ffa-4d3d-88c1-a0f2960e529f]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:24 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Volume volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3 (696a3094-13d3-4d13-b43c-73a1dee4cdf3): created successfully Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87c4fce-1fac-4c7d-b5fd-f15165789e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Flow 'volume_create_manager' (d33baa45-851b-431a-9145-5ed089f53278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:25 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-5013010f-c911-4f07-9aee-6a4c27b41dba tempest-VolumesGetTest-1604525800 None] Created volume successfully. Sep 28 17:13:25 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c Sep 28 17:13:25 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:25 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c" returned: 0 in 0.598s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:25 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5 Sep 28 17:13:25 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:26 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5" returned: 0 in 0.551s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:26 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5 Sep 28 17:13:26 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:26 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c.543087de-2e2f-4c5e-baa6-8ce9dd111ac5" returned: 0 in 0.558s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-543087de-2e2f-4c5e-baa6-8ce9dd111ac5" released by "_delete_snapshot" :: held 2.620s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-eedc2b38-c9a4-4aa3-b63c-7402268d977c" released by "delete_snapshot" :: held 2.680s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:26 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] Created reservations ['0eec27ee-b7aa-4ac3-9c92-da7bd8c5cb36', 'e00abe65-91dc-4d69-92fe-8e191ad37c96', '4578d875-6280-4503-8915-c1f377dcad32', '5e2fc5ce-93d8-45ec-bada-87e4f4dffd31'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:26 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] Delete snapshot completed successfully. Sep 28 17:13:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-190ee8b5-7897-4320-b3a3-0211ed8460c0 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-543087de-2e2f-4c5e-baa6-8ce9dd111ac5-delete_snapshot" released by "delete_snapshot" :: held 3.064s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Flow 'volume_create_manager' (8ae203f0-b37f-400a-abd3-72db7dcbab5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd573942-9d67-4853-9430-941ee4dcc71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd573942-9d67-4853-9430-941ee4dcc71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-302692167',display_name='tempest-VolumesGetTest-Volume-962400032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=546f82c1-8099-41b8-8873-3d418736cded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac3176978694ef49aeed5083a9b17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:27Z,use_quota=True,user_id='7054348844054a8d8d1254e8645685f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7466490e-288e-4a56-8431-04f7db7abe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7466490e-288e-4a56-8431-04f7db7abe63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f46968-bea7-4d10-abfb-5f44bbf94d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f46968-bea7-4d10-abfb-5f44bbf94d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '546f82c1-8099-41b8-8873-3d418736cded', 'volume_name': 'volume-546f82c1-8099-41b8-8873-3d418736cded', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99df71f3-eb9c-499f-91d9-bbb6a2135b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99df71f3-eb9c-499f-91d9-bbb6a2135b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5b786f-4b1e-4faf-81f6-5a7057969aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:27 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Volume 546f82c1-8099-41b8-8873-3d418736cded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-546f82c1-8099-41b8-8873-3d418736cded', 'volume_size': 1} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-302692167',display_name='tempest-VolumesGetTest-Volume-962400032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=546f82c1-8099-41b8-8873-3d418736cded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac3176978694ef49aeed5083a9b17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:27Z,use_quota=True,user_id='7054348844054a8d8d1254e8645685f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Creating volume 546f82c1-8099-41b8-8873-3d418736cded {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:27 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:13:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-546f82c1-8099-41b8-8873-3d418736cded 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:27 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-546f82c1-8099-41b8-8873-3d418736cded 1073741824 Sep 28 17:13:27 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:28 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-546f82c1-8099-41b8-8873-3d418736cded 1073741824" returned: 0 in 0.855s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-546f82c1-8099-41b8-8873-3d418736cded {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:28 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-546f82c1-8099-41b8-8873-3d418736cded Sep 28 17:13:28 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Flow 'volume_create_manager' (b51d6760-21df-4792-9481-b4a4ecb43c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488ad363-26ee-49e3-9a9e-77f4bb7251b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488ad363-26ee-49e3-9a9e-77f4bb7251b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1474245385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e491c2fa-1c8e-465b-8580-4a5458159622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e746411fcffd4ff5a38c5ca0d9e56f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:28Z,use_quota=True,user_id='03c8965ccbc943f0a45520238878c382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f16a1f6-d483-41f5-a639-5872279bca22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f16a1f6-d483-41f5-a639-5872279bca22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22996a80-7952-4a53-9652-81dca7924a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22996a80-7952-4a53-9652-81dca7924a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e491c2fa-1c8e-465b-8580-4a5458159622', 'volume_name': 'volume-e491c2fa-1c8e-465b-8580-4a5458159622', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775ba1db-4b88-4b85-92e3-645879db63ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775ba1db-4b88-4b85-92e3-645879db63ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34510482-bca0-45b5-9518-c73a39c3b75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:28 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Volume e491c2fa-1c8e-465b-8580-4a5458159622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e491c2fa-1c8e-465b-8580-4a5458159622', 'volume_size': 1} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Flow 'volume_create_manager' (796faf52-3b04-4c7e-b357-4f35f739758f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6ef592-275d-4f55-9670-f406b687c02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6ef592-275d-4f55-9670-f406b687c02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-28643585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8711c3-f9c2-46cf-a843-38f85e05944d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2165e596dd410eb6640da78bd45a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:28Z,use_quota=True,user_id='69b217116aca432c93cde73cd85e40f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57a04d8-63e5-4133-bccb-1f2705c9bb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57a04d8-63e5-4133-bccb-1f2705c9bb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf16b03-ee49-4cba-b87e-208555b24237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf16b03-ee49-4cba-b87e-208555b24237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf8711c3-f9c2-46cf-a843-38f85e05944d', 'volume_name': 'volume-cf8711c3-f9c2-46cf-a843-38f85e05944d', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99f8cc5-ba12-43dd-9af0-0622e751f65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99f8cc5-ba12-43dd-9af0-0622e751f65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3850aa0e-9268-471b-8a4d-8067d1b85bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:28 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Volume cf8711c3-f9c2-46cf-a843-38f85e05944d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf8711c3-f9c2-46cf-a843-38f85e05944d', 'volume_size': 1} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:28 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-546f82c1-8099-41b8-8873-3d418736cded" returned: 0 in 0.322s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.155s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1474245385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e491c2fa-1c8e-465b-8580-4a5458159622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e746411fcffd4ff5a38c5ca0d9e56f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:28Z,use_quota=True,user_id='03c8965ccbc943f0a45520238878c382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Creating volume e491c2fa-1c8e-465b-8580-4a5458159622 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:28 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5b786f-4b1e-4faf-81f6-5a7057969aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-546f82c1-8099-41b8-8873-3d418736cded', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:28 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 1073741824 Sep 28 17:13:28 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7649515c-af31-43d3-9af3-b0b547fdce3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:28 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Volume volume-546f82c1-8099-41b8-8873-3d418736cded (546f82c1-8099-41b8-8873-3d418736cded): created successfully Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7649515c-af31-43d3-9af3-b0b547fdce3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:28 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Flow 'volume_create_manager' (8ae203f0-b37f-400a-abd3-72db7dcbab5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:28 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-865edbd2-d5b9-467c-acd6-ef12a249da25 tempest-VolumesGetTest-1604525800 None] Created volume successfully. Sep 28 17:13:29 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 1073741824" returned: 0 in 0.542s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:29 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 Sep 28 17:13:29 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] Acquiring lock "cinder-546f82c1-8099-41b8-8873-3d418736cded-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:29 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622" returned: 0 in 0.326s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] Lock "cinder-546f82c1-8099-41b8-8873-3d418736cded-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.989s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-28643585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8711c3-f9c2-46cf-a843-38f85e05944d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2165e596dd410eb6640da78bd45a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:28Z,use_quota=True,user_id='69b217116aca432c93cde73cd85e40f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Creating volume cf8711c3-f9c2-46cf-a843-38f85e05944d {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:29 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:29 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d 1073741824 Sep 28 17:13:29 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34510482-bca0-45b5-9518-c73a39c3b75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e491c2fa-1c8e-465b-8580-4a5458159622', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886c009a-ce86-4981-ab8a-fca642734f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:29 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Volume volume-e491c2fa-1c8e-465b-8580-4a5458159622 (e491c2fa-1c8e-465b-8580-4a5458159622): created successfully Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886c009a-ce86-4981-ab8a-fca642734f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Flow 'volume_create_manager' (b51d6760-21df-4792-9481-b4a4ecb43c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:29 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-dbbfc4e9-8b81-446d-b5a2-99660cf3f9db tempest-TestImageHashVerification-480878221 None] Created volume successfully. Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] Acquiring lock "cinder-quobyte-546f82c1-8099-41b8-8873-3d418736cded" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-546f82c1-8099-41b8-8873-3d418736cded" acquired by "delete_volume" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f338146-13cd-4530-a788-379099ccc2c1]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-546f82c1-8099-41b8-8873-3d418736cded {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:30 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-546f82c1-8099-41b8-8873-3d418736cded Sep 28 17:13:30 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:30 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d 1073741824" returned: 0 in 0.778s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:30 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:30 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d Sep 28 17:13:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-546f82c1-8099-41b8-8873-3d418736cded" returned: 0 in 0.660s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-546f82c1-8099-41b8-8873-3d418736cded {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:30 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:30 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-546f82c1-8099-41b8-8873-3d418736cded Sep 28 17:13:30 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:30 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d" returned: 0 in 0.353s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:30 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-546f82c1-8099-41b8-8873-3d418736cded" returned: 0 in 0.332s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-546f82c1-8099-41b8-8873-3d418736cded" released by "delete_volume" :: held 1.059s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3850aa0e-9268-471b-8a4d-8067d1b85bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf8711c3-f9c2-46cf-a843-38f85e05944d', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d566ae32-1a99-4ffa-bbea-0c48aabb1a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:30 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Volume volume-cf8711c3-f9c2-46cf-a843-38f85e05944d (cf8711c3-f9c2-46cf-a843-38f85e05944d): created successfully Sep 28 17:13:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d566ae32-1a99-4ffa-bbea-0c48aabb1a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Flow 'volume_create_manager' (796faf52-3b04-4c7e-b357-4f35f739758f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:30 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0551a922-cb4f-46af-a6a9-a5d0794623e3 tempest-VolumesSnapshotTestJSON-717735650 None] Created volume successfully. Sep 28 17:13:31 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] Created reservations ['91cb73da-4ff4-4d3f-a51a-f82b68cd14a2', 'fe853f15-b46c-4106-bf0a-99d14fe042d6', 'd9f13029-2f9a-459a-9df5-4ec6cc2afde0', 'a7785204-e8c2-45b5-9f27-5cf320893350'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:31 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:13:31 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:31 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.331s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:31 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:31 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] Deleted volume successfully. Sep 28 17:13:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6d55073e-60d2-478a-ac0c-e89350a2f6c6 tempest-VolumesGetTest-1604525800 None] Lock "cinder-546f82c1-8099-41b8-8873-3d418736cded-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4b3650cc-c524-4193-9cdf-45d23517ffc1 tempest-TestImageHashVerification-480878221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4b3650cc-c524-4193-9cdf-45d23517ffc1 tempest-TestImageHashVerification-480878221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:31 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e241e34-a6a7-4aae-989b-cd8869f123ef]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4b3650cc-c524-4193-9cdf-45d23517ffc1 tempest-TestImageHashVerification-480878221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:31 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 Sep 28 17:13:31 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] Acquiring lock "cinder-696a3094-13d3-4d13-b43c-73a1dee4cdf3-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] Lock "cinder-696a3094-13d3-4d13-b43c-73a1dee4cdf3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] Acquiring lock "cinder-quobyte-696a3094-13d3-4d13-b43c-73a1dee4cdf3" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-696a3094-13d3-4d13-b43c-73a1dee4cdf3" acquired by "delete_volume" :: waited 0.028s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:32 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[5891e350-4f40-465a-8623-892b7370a679]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:32 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4b3650cc-c524-4193-9cdf-45d23517ffc1 tempest-TestImageHashVerification-480878221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622" returned: 0 in 0.541s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:32 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[620f6f07-54bc-426d-b592-620714e19f5a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4b3650cc-c524-4193-9cdf-45d23517ffc1 tempest-TestImageHashVerification-480878221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:32 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3 Sep 28 17:13:32 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:32 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 Sep 28 17:13:32 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:32 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3" returned: 0 in 0.452s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:32 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3 Sep 28 17:13:32 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:32 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4b3650cc-c524-4193-9cdf-45d23517ffc1 tempest-TestImageHashVerification-480878221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622" returned: 0 in 0.508s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4b3650cc-c524-4193-9cdf-45d23517ffc1 tempest-TestImageHashVerification-480878221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 /opt/stack/data/cinder/conversion/e491c2fa-1c8e-465b-8580-4a5458159622.temp_image.60a6ab27-08a5-40fc-9723-e0a427621f1aj202s3nb.img {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:32 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 /opt/stack/data/cinder/conversion/e491c2fa-1c8e-465b-8580-4a5458159622.temp_image.60a6ab27-08a5-40fc-9723-e0a427621f1aj202s3nb.img Sep 28 17:13:32 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:33 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-696a3094-13d3-4d13-b43c-73a1dee4cdf3" returned: 0 in 0.361s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] Lock "cinder-quobyte-696a3094-13d3-4d13-b43c-73a1dee4cdf3" released by "delete_volume" :: held 0.874s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:UPDATE=149,cinder:SELECT=140,cinder:INSERT=44,cinder:DELETE=10 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:UPDATE=154,cinder:INSERT=44,cinder:DELETE=14,cinder:SELECT=119 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Flow 'volume_create_manager' (dc5bd179-227f-4272-8292-02d8d577a2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef0f8ecb-5d6c-40b0-9ad9-6590e91a67b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] Created reservations ['c096b292-9466-4b3b-ac7b-52bf6115f533', 'f2c66e5b-ffbf-4331-9d1e-15ba5d68b30c', '1fca69d0-7657-4e2c-8f76-bc22943c1eb5', '4a40723b-c080-4de8-8f60-9d3b1e7a602e'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef0f8ecb-5d6c-40b0-9ad9-6590e91a67b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1580491822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8346ec04-d364-4793-a826-44cf03462e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3dbf0fca384155a39345afc9b5fd29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:33Z,use_quota=True,user_id='239da7fe24bd491f9d7510fa5c4242b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2146ea-d885-44ba-ba8e-ae8be2b96291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2146ea-d885-44ba-ba8e-ae8be2b96291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58683d44-1b7b-42be-b021-83d63d254087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58683d44-1b7b-42be-b021-83d63d254087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8346ec04-d364-4793-a826-44cf03462e61', 'volume_name': 'volume-8346ec04-d364-4793-a826-44cf03462e61', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11aa07aa-fab4-4d1d-8950-ff1981817146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11aa07aa-fab4-4d1d-8950-ff1981817146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948057e0-ddf9-47d1-9720-a9754981866d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:33 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Volume 8346ec04-d364-4793-a826-44cf03462e61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8346ec04-d364-4793-a826-44cf03462e61', 'volume_size': 1} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:33 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:13:33 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:33 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.313s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:33 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] Deleted volume successfully. Sep 28 17:13:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-521f8aa0-e7bc-4231-92a7-81c9856af093 tempest-VolumesGetTest-1604525800 None] Lock "cinder-696a3094-13d3-4d13-b43c-73a1dee4cdf3-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:40 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4b3650cc-c524-4193-9cdf-45d23517ffc1 tempest-TestImageHashVerification-480878221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 /opt/stack/data/cinder/conversion/e491c2fa-1c8e-465b-8580-4a5458159622.temp_image.60a6ab27-08a5-40fc-9723-e0a427621f1aj202s3nb.img" returned: 0 in 7.414s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:40 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a36bde-8222-4740-928a-0afad09b9a08]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4b3650cc-c524-4193-9cdf-45d23517ffc1 tempest-TestImageHashVerification-480878221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:40 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 Sep 28 17:13:40 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:40 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4b3650cc-c524-4193-9cdf-45d23517ffc1 tempest-TestImageHashVerification-480878221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622" returned: 0 in 0.608s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:40 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-4b3650cc-c524-4193-9cdf-45d23517ffc1 tempest-TestImageHashVerification-480878221 None] Image conversion details: src /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622, size 1024.00 MB, duration 7.42 sec, destination /opt/stack/data/cinder/conversion/e491c2fa-1c8e-465b-8580-4a5458159622.temp_image.60a6ab27-08a5-40fc-9723-e0a427621f1aj202s3nb.img {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:13:40 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-4b3650cc-c524-4193-9cdf-45d23517ffc1 tempest-TestImageHashVerification-480878221 None] Converted 1024.00 MB image at 138.09 MB/s Sep 28 17:13:40 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-4b3650cc-c524-4193-9cdf-45d23517ffc1 tempest-TestImageHashVerification-480878221 None] 60a6ab27-08a5-40fc-9723-e0a427621f1a was raw, no need to convert to raw {{(pid=86970) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 17:13:41 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Flow 'volume_create_manager' (3e086455-5630-4b5d-be89-7d5b744ea7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6918f261-edf7-44e6-adb6-a56743f4fd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6918f261-edf7-44e6-adb6-a56743f4fd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-258458273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac062531-e423-4d69-b9eb-ff29c40cf11c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5687277c924374bde4bb8f563e1c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:41Z,use_quota=True,user_id='b52792d8218f48cb841f5e8966783904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff903a67-f30c-4e7a-a05b-6cdbd81c9f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff903a67-f30c-4e7a-a05b-6cdbd81c9f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bc6e71-c082-4ad0-9e81-b879acb26980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bc6e71-c082-4ad0-9e81-b879acb26980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac062531-e423-4d69-b9eb-ff29c40cf11c', 'volume_name': 'volume-ac062531-e423-4d69-b9eb-ff29c40cf11c', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f201769c-27eb-4d53-bafe-bc3f39fdb69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f201769c-27eb-4d53-bafe-bc3f39fdb69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de51be8-0469-4a69-bbce-e2e0350e06c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:41 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Volume ac062531-e423-4d69-b9eb-ff29c40cf11c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac062531-e423-4d69-b9eb-ff29c40cf11c', 'volume_size': 1} Sep 28 17:13:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:50 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=7,cinder:INSERT=4,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:13:51 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:UPDATE=7,cinder:SELECT=5 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:01 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:14:01 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4b3650cc-c524-4193-9cdf-45d23517ffc1 tempest-TestImageHashVerification-480878221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.685s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4b3650cc-c524-4193-9cdf-45d23517ffc1 tempest-TestImageHashVerification-480878221 None] Uploaded volume to glance image-id: 60a6ab27-08a5-40fc-9723-e0a427621f1a. {{(pid=86970) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 29.614s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] Creating offline snapshot 4bc1cada-843e-4e40-a408-169731067b03 of volume cf8711c3-f9c2-46cf-a843-38f85e05944d {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:14:01 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.333s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:01 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-4b3650cc-c524-4193-9cdf-45d23517ffc1 tempest-TestImageHashVerification-480878221 None] Copy volume to image completed successfully. Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ec563a-1bae-4ed8-8db3-93cd04aee880]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:01 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d Sep 28 17:14:01 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:01 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d" returned: 0 in 0.455s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:01 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03 1G Sep 28 17:14:01 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:02 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03 1G" returned: 0 in 0.526s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf8711c3-f9c2-46cf-a843-38f85e05944d -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:02 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf8711c3-f9c2-46cf-a843-38f85e05944d -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03 Sep 28 17:14:02 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] Acquiring lock "cinder-e491c2fa-1c8e-465b-8580-4a5458159622-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] Lock "cinder-e491c2fa-1c8e-465b-8580-4a5458159622-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] Acquiring lock "cinder-quobyte-e491c2fa-1c8e-465b-8580-4a5458159622" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] Lock "cinder-quobyte-e491c2fa-1c8e-465b-8580-4a5458159622" acquired by "delete_volume" :: waited 0.018s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:02 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4dbab8-4543-4eea-91f6-182d73c153cf]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:02 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf8711c3-f9c2-46cf-a843-38f85e05944d -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03" returned: 0 in 0.475s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:02 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03 is being set with open permissions: ugo+rw Sep 28 17:14:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:02 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03 Sep 28 17:14:02 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:03 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 Sep 28 17:14:03 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:03 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03" returned: 0 in 0.290s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:03 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.info Sep 28 17:14:03 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:03 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622" returned: 0 in 0.421s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:03 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622 Sep 28 17:14:03 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:03 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.info" returned: 0 in 0.371s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:03 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.info is being set with open permissions: ugo+rw Sep 28 17:14:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:03 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e491c2fa-1c8e-465b-8580-4a5458159622" returned: 0 in 0.324s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:03 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.info Sep 28 17:14:03 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] Lock "cinder-quobyte-e491c2fa-1c8e-465b-8580-4a5458159622" released by "delete_volume" :: held 0.795s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:03 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] Created reservations ['a0ff5ce4-869d-4f9f-a2ae-afd03c15b8d9', 'c8a47153-602d-4a59-a173-59267accf55c', '571ae309-8741-4419-9c73-b1aaafc8d43f', '6dc8d9de-a19e-424c-a927-38efdea9c63d'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:03 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:14:03 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:03 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.info" returned: 0 in 0.349s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.641s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.706s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1580491822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8346ec04-d364-4793-a826-44cf03462e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3dbf0fca384155a39345afc9b5fd29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:33Z,use_quota=True,user_id='239da7fe24bd491f9d7510fa5c4242b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Creating volume 8346ec04-d364-4793-a826-44cf03462e61 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:04 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:14:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8346ec04-d364-4793-a826-44cf03462e61 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:04 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-db304feb-3836-423a-8070-d2cf5433b91a tempest-VolumesSnapshotTestJSON-717735650 None] Create snapshot completed successfully Sep 28 17:14:04 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8346ec04-d364-4793-a826-44cf03462e61 1073741824 Sep 28 17:14:04 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:04 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.370s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:04 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:04 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] Deleted volume successfully. Sep 28 17:14:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2adc4629-8d96-474d-b5b0-851353c71235 tempest-TestImageHashVerification-480878221 None] Lock "cinder-e491c2fa-1c8e-465b-8580-4a5458159622-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:04 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8346ec04-d364-4793-a826-44cf03462e61 1073741824" returned: 0 in 0.668s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8346ec04-d364-4793-a826-44cf03462e61 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:04 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8346ec04-d364-4793-a826-44cf03462e61 Sep 28 17:14:04 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:05 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8346ec04-d364-4793-a826-44cf03462e61" returned: 0 in 0.481s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.050s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-258458273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac062531-e423-4d69-b9eb-ff29c40cf11c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5687277c924374bde4bb8f563e1c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:41Z,use_quota=True,user_id='b52792d8218f48cb841f5e8966783904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Creating volume ac062531-e423-4d69-b9eb-ff29c40cf11c {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:05 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ac062531-e423-4d69-b9eb-ff29c40cf11c 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948057e0-ddf9-47d1-9720-a9754981866d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8346ec04-d364-4793-a826-44cf03462e61', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a56913-ffba-4d76-9126-31a10b48fcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:05 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ac062531-e423-4d69-b9eb-ff29c40cf11c 1073741824 Sep 28 17:14:05 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:05 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Volume volume-8346ec04-d364-4793-a826-44cf03462e61 (8346ec04-d364-4793-a826-44cf03462e61): created successfully Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a56913-ffba-4d76-9126-31a10b48fcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Flow 'volume_create_manager' (dc5bd179-227f-4272-8292-02d8d577a2d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:05 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ac046863-fee6-444c-90f0-faa9dd1fa9aa tempest-VolumesTransfersTest-13968809 None] Created volume successfully. Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Flow 'volume_create_manager' (4ece11e9-abf6-410c-bf56-b1f80c45b422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ccd322-34ab-49c2-8d96-61eda55aca92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ccd322-34ab-49c2-8d96-61eda55aca92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2119981198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470d8524-94e8-4274-9111-ca583946d6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2165e596dd410eb6640da78bd45a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4bc1cada-843e-4e40-a408-169731067b03,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:05Z,use_quota=True,user_id='69b217116aca432c93cde73cd85e40f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c48971-8346-40b2-adff-cbe1b800c03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c48971-8346-40b2-adff-cbe1b800c03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208343e8-6df0-4f5c-8254-8210e700fcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208343e8-6df0-4f5c-8254-8210e700fcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '470d8524-94e8-4274-9111-ca583946d6d3', 'volume_name': 'volume-470d8524-94e8-4274-9111-ca583946d6d3', 'volume_size': 2, 'snapshot_id': '4bc1cada-843e-4e40-a408-169731067b03'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b899c3-9d68-43a7-94e1-24e8713c2ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b899c3-9d68-43a7-94e1-24e8713c2ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7c9953-2699-459a-bbca-00c0974c6b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:05 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Volume 470d8524-94e8-4274-9111-ca583946d6d3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-470d8524-94e8-4274-9111-ca583946d6d3', 'volume_size': 2, 'snapshot_id': '4bc1cada-843e-4e40-a408-169731067b03'} Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:05 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ac062531-e423-4d69-b9eb-ff29c40cf11c 1073741824" returned: 0 in 0.642s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ac062531-e423-4d69-b9eb-ff29c40cf11c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:06 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ac062531-e423-4d69-b9eb-ff29c40cf11c Sep 28 17:14:06 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:06 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ac062531-e423-4d69-b9eb-ff29c40cf11c" returned: 0 in 0.366s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.791s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-quobyte-4bc1cada-843e-4e40-a408-169731067b03-470d8524-94e8-4274-9111-ca583946d6d3" by "_create_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de51be8-0469-4a69-bbce-e2e0350e06c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac062531-e423-4d69-b9eb-ff29c40cf11c', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d210946b-afca-4900-97bf-ca3e0c839078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-4bc1cada-843e-4e40-a408-169731067b03-470d8524-94e8-4274-9111-ca583946d6d3" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Creating volume 470d8524-94e8-4274-9111-ca583946d6d3 from snapshot 4bc1cada-843e-4e40-a408-169731067b03 {{(pid=86970) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-quobyte-470d8524-94e8-4274-9111-ca583946d6d3" by "_copy_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:06 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Volume volume-ac062531-e423-4d69-b9eb-ff29c40cf11c (ac062531-e423-4d69-b9eb-ff29c40cf11c): created successfully Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d210946b-afca-4900-97bf-ca3e0c839078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Flow 'volume_create_manager' (3e086455-5630-4b5d-be89-7d5b744ea7c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:06 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2a22d5e8-91b8-4303-bc91-b35cc515dc61 tempest-VolumesNegativeTest-1135291177 None] Created volume successfully. Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-470d8524-94e8-4274-9111-ca583946d6d3" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] snapshot: 4bc1cada-843e-4e40-a408-169731067b03, volume: 470d8524-94e8-4274-9111-ca583946d6d3, {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbf3d86-769b-448e-bdab-973e08c35a69]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:06 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03 Sep 28 17:14:06 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:07 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03" returned: 0 in 0.566s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf8711c3-f9c2-46cf-a843-38f85e05944d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:07 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e022869-2a8c-4781-8604-7d969fd0982b]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:07 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-9df6aa89-387d-408a-b2f7-4a3baf4c6044 tempest-VolumesTransfersTest-2138167329 None] Transfer volume completed successfully. Sep 28 17:14:07 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d Sep 28 17:14:07 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:07 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d" returned: 0 in 0.583s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:14:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Creating direct copy from snapshot {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:14:07 devstack cinder-volume[86970]: DEBUG cinder.utils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Path /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-470d8524-94e8-4274-9111-ca583946d6d3 not found in is_blk_device check {{(pid=86970) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:14:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-470d8524-94e8-4274-9111-ca583946d6d3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:07 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-470d8524-94e8-4274-9111-ca583946d6d3 Sep 28 17:14:07 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] Acquiring lock "cinder-8346ec04-d364-4793-a826-44cf03462e61-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] Lock "cinder-8346ec04-d364-4793-a826-44cf03462e61-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] Acquiring lock "cinder-quobyte-8346ec04-d364-4793-a826-44cf03462e61" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] Lock "cinder-quobyte-8346ec04-d364-4793-a826-44cf03462e61" acquired by "delete_volume" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:08 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad8906d-8069-4f81-9fe7-ecea6ce59f6a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8346ec04-d364-4793-a826-44cf03462e61 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:08 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8346ec04-d364-4793-a826-44cf03462e61 Sep 28 17:14:08 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:09 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8346ec04-d364-4793-a826-44cf03462e61" returned: 0 in 0.697s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8346ec04-d364-4793-a826-44cf03462e61 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:09 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8346ec04-d364-4793-a826-44cf03462e61 Sep 28 17:14:09 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:09 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8346ec04-d364-4793-a826-44cf03462e61" returned: 0 in 0.693s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] Lock "cinder-quobyte-8346ec04-d364-4793-a826-44cf03462e61" released by "delete_volume" :: held 1.500s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:09 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] Created reservations ['c8eba973-0f89-4ed7-ae5b-5ff4a2b5875a', 'c3801632-4c3d-4442-bab9-ecd5a1b42fc6', '68cabc12-8e98-4bb8-984c-9d5584cdd0d2', 'ab950b63-88c2-4e9f-8001-840fee54b458'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:10 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:14:10 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:10 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.541s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:10 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:10 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] Deleted volume successfully. Sep 28 17:14:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-934bab23-2ee7-4f3c-95fe-6f6b7f064ee7 tempest-VolumesTransfersTest-915360185 None] Lock "cinder-8346ec04-d364-4793-a826-44cf03462e61-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:12 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Flow 'volume_create_manager' (07ffe8d2-9ff8-4c08-a7d5-f3248d4bd3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc8046a-7e6c-4c14-90e6-d694b17b2aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc8046a-7e6c-4c14-90e6-d694b17b2aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1338114763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a660e915-2b7c-48b7-9d18-2a94dca4121c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3dbf0fca384155a39345afc9b5fd29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:13Z,use_quota=True,user_id='239da7fe24bd491f9d7510fa5c4242b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c28e79-b6fa-404a-bdb5-4720fbf20f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c28e79-b6fa-404a-bdb5-4720fbf20f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad999d5-af9a-485b-8dc4-e94783cce7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad999d5-af9a-485b-8dc4-e94783cce7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a660e915-2b7c-48b7-9d18-2a94dca4121c', 'volume_name': 'volume-a660e915-2b7c-48b7-9d18-2a94dca4121c', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6a6958-7b66-4952-95cb-60eb2747a733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6a6958-7b66-4952-95cb-60eb2747a733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443d98e1-f517-4591-8520-e631191b8a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:12 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Volume a660e915-2b7c-48b7-9d18-2a94dca4121c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a660e915-2b7c-48b7-9d18-2a94dca4121c', 'volume_size': 1} Sep 28 17:14:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:17 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-470d8524-94e8-4274-9111-ca583946d6d3" returned: 0 in 9.963s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:17 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Image conversion details: src /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d, size 1024.00 MB, duration 9.96 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-470d8524-94e8-4274-9111-ca583946d6d3 {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:14:17 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Converted 1024.00 MB image at 102.77 MB/s Sep 28 17:14:17 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-470d8524-94e8-4274-9111-ca583946d6d3 is being set with open permissions: ugo+rw Sep 28 17:14:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-470d8524-94e8-4274-9111-ca583946d6d3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:17 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-470d8524-94e8-4274-9111-ca583946d6d3 Sep 28 17:14:17 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:18 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-470d8524-94e8-4274-9111-ca583946d6d3" returned: 0 in 0.343s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-470d8524-94e8-4274-9111-ca583946d6d3" released by "_copy_volume_from_snapshot" :: held 11.585s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-4bc1cada-843e-4e40-a408-169731067b03-470d8524-94e8-4274-9111-ca583946d6d3" released by "_create_volume_from_snapshot" :: held 11.715s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.764s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.166s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1338114763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a660e915-2b7c-48b7-9d18-2a94dca4121c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3dbf0fca384155a39345afc9b5fd29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:13Z,use_quota=True,user_id='239da7fe24bd491f9d7510fa5c4242b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Creating volume a660e915-2b7c-48b7-9d18-2a94dca4121c {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:18 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a660e915-2b7c-48b7-9d18-2a94dca4121c 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:18 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a660e915-2b7c-48b7-9d18-2a94dca4121c 1073741824 Sep 28 17:14:18 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7c9953-2699-459a-bbca-00c0974c6b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-470d8524-94e8-4274-9111-ca583946d6d3', 'volume_size': 2, 'snapshot_id': '4bc1cada-843e-4e40-a408-169731067b03'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0b3785-3f13-436f-a592-88d10c091cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:18 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Volume volume-470d8524-94e8-4274-9111-ca583946d6d3 (470d8524-94e8-4274-9111-ca583946d6d3): created successfully Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0b3785-3f13-436f-a592-88d10c091cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Flow 'volume_create_manager' (4ece11e9-abf6-410c-bf56-b1f80c45b422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:18 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-b081da0e-1906-441a-8449-4cbe913b9fda tempest-VolumesSnapshotTestJSON-717735650 None] Created volume successfully. Sep 28 17:14:18 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a660e915-2b7c-48b7-9d18-2a94dca4121c 1073741824" returned: 0 in 0.605s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a660e915-2b7c-48b7-9d18-2a94dca4121c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:18 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a660e915-2b7c-48b7-9d18-2a94dca4121c Sep 28 17:14:18 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:19 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a660e915-2b7c-48b7-9d18-2a94dca4121c" returned: 0 in 0.398s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443d98e1-f517-4591-8520-e631191b8a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a660e915-2b7c-48b7-9d18-2a94dca4121c', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083f1ba6-8d47-4984-9b17-e70ab1967d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-470d8524-94e8-4274-9111-ca583946d6d3-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:19 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Volume volume-a660e915-2b7c-48b7-9d18-2a94dca4121c (a660e915-2b7c-48b7-9d18-2a94dca4121c): created successfully Sep 28 17:14:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083f1ba6-8d47-4984-9b17-e70ab1967d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Flow 'volume_create_manager' (07ffe8d2-9ff8-4c08-a7d5-f3248d4bd3fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-470d8524-94e8-4274-9111-ca583946d6d3-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:19 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-9ba2727b-dbf3-4f0c-9cad-10b51fd5c03c tempest-VolumesTransfersTest-13968809 None] Created volume successfully. Sep 28 17:14:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-quobyte-470d8524-94e8-4274-9111-ca583946d6d3" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-470d8524-94e8-4274-9111-ca583946d6d3" acquired by "delete_volume" :: waited 0.039s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:19 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b4d3b5-4c3f-4808-8996-13d12d13ad1c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-470d8524-94e8-4274-9111-ca583946d6d3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:19 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-470d8524-94e8-4274-9111-ca583946d6d3 Sep 28 17:14:19 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:20 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-470d8524-94e8-4274-9111-ca583946d6d3" returned: 0 in 1.018s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-470d8524-94e8-4274-9111-ca583946d6d3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:20 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-470d8524-94e8-4274-9111-ca583946d6d3 Sep 28 17:14:20 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] Acquiring lock "cinder-a660e915-2b7c-48b7-9d18-2a94dca4121c-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] Lock "cinder-a660e915-2b7c-48b7-9d18-2a94dca4121c-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] Acquiring lock "cinder-quobyte-a660e915-2b7c-48b7-9d18-2a94dca4121c" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] Lock "cinder-quobyte-a660e915-2b7c-48b7-9d18-2a94dca4121c" acquired by "delete_volume" :: waited 0.036s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b92c34c-7005-496b-93c7-3e3e954349f2]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a660e915-2b7c-48b7-9d18-2a94dca4121c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:21 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-470d8524-94e8-4274-9111-ca583946d6d3" returned: 0 in 0.527s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-470d8524-94e8-4274-9111-ca583946d6d3" released by "delete_volume" :: held 1.724s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:21 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a660e915-2b7c-48b7-9d18-2a94dca4121c Sep 28 17:14:21 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] Created reservations ['173681ce-eabc-4910-842e-10313a67e4a3', 'f6bcbd18-4d01-4943-9ac8-fcd9b763168b', '363e737d-eb58-4536-a16b-848c6a7d7537', '0a6e8966-ce7d-48f7-acb3-aabfa3c8e336'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:21 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:14:21 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:21 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a660e915-2b7c-48b7-9d18-2a94dca4121c" returned: 0 in 0.661s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a660e915-2b7c-48b7-9d18-2a94dca4121c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-4bc1cada-843e-4e40-a408-169731067b03-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:21 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a660e915-2b7c-48b7-9d18-2a94dca4121c Sep 28 17:14:21 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:21 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.487s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:21 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] Deleted volume successfully. Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-4bc1cada-843e-4e40-a408-169731067b03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.141s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-quobyte-cf8711c3-f9c2-46cf-a843-38f85e05944d" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7dc02242-7918-4bde-a95c-edb4ab382acb tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-470d8524-94e8-4274-9111-ca583946d6d3-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-cf8711c3-f9c2-46cf-a843-38f85e05944d" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-quobyte-4bc1cada-843e-4e40-a408-169731067b03" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-4bc1cada-843e-4e40-a408-169731067b03" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] Deleting offline snapshot 4bc1cada-843e-4e40-a408-169731067b03 of volume cf8711c3-f9c2-46cf-a843-38f85e05944d {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:14:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] snapshot_file for this snap is: volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:14:22 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2b9696-80ad-48bd-88d9-eedbf375f1e2]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:22 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a660e915-2b7c-48b7-9d18-2a94dca4121c" returned: 0 in 0.545s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] Lock "cinder-quobyte-a660e915-2b7c-48b7-9d18-2a94dca4121c" released by "delete_volume" :: held 1.352s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:22 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03 Sep 28 17:14:22 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:22 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] Created reservations ['88d6b612-345a-4294-810f-2bb13c03f647', 'b861de69-9e49-4b87-bb73-edabcea001f0', '6dc250ec-f1e9-42fb-aa75-efb5c67a8135', '2f212957-8ab1-4660-b47f-60e73b12d631'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:22 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:14:22 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:22 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03" returned: 0 in 0.840s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf8711c3-f9c2-46cf-a843-38f85e05944d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:22 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9141f76-c78e-4a3f-aae9-621f20aa2686]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:23 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d Sep 28 17:14:23 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:23 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.662s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:23 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:23 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] Deleted volume successfully. Sep 28 17:14:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9a86168e-9010-44da-9ef1-e4454f76e3eb tempest-VolumesTransfersTest-915360185 None] Lock "cinder-a660e915-2b7c-48b7-9d18-2a94dca4121c-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:24 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d" returned: 0 in 1.374s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:24 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03 Sep 28 17:14:24 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:25 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03" returned: 0 in 0.733s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:25 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03 Sep 28 17:14:25 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:25 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d.4bc1cada-843e-4e40-a408-169731067b03" returned: 0 in 0.538s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:25 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-4bc1cada-843e-4e40-a408-169731067b03" released by "_delete_snapshot" :: held 3.755s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:25 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-cf8711c3-f9c2-46cf-a843-38f85e05944d" released by "delete_snapshot" :: held 3.798s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:25 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] Created reservations ['83d6fd64-929b-41a0-ab9d-e57784247a9e', 'd9c8de7c-c760-4b9d-99f6-4e52e17380f2', '6ea26e82-2523-4b5b-b679-9340e241c220', '4e30e7b1-f307-445d-b7a9-a807972258ab'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:26 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] Delete snapshot completed successfully. Sep 28 17:14:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5122420a-436d-4338-916a-740c399a5e7c tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-4bc1cada-843e-4e40-a408-169731067b03-delete_snapshot" released by "delete_snapshot" :: held 4.151s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-cf8711c3-f9c2-46cf-a843-38f85e05944d-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-cf8711c3-f9c2-46cf-a843-38f85e05944d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-quobyte-cf8711c3-f9c2-46cf-a843-38f85e05944d" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-cf8711c3-f9c2-46cf-a843-38f85e05944d" acquired by "delete_volume" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:26 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0610662-1cb7-445c-8d79-52a930d4c838]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:26 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d Sep 28 17:14:26 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:27 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d" returned: 0 in 0.723s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:27 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d Sep 28 17:14:27 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:27 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cf8711c3-f9c2-46cf-a843-38f85e05944d" returned: 0 in 0.413s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-cf8711c3-f9c2-46cf-a843-38f85e05944d" released by "delete_volume" :: held 1.228s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:27 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] Created reservations ['69d75729-1242-45e8-befe-9da7702a533b', '8070e629-f883-4606-a6af-58678d25001f', '1dacf9fb-d8bb-4add-a2cc-f1f0c4965d5a', '7166f7a6-677a-4aab-83f4-421d2034dcb5'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:28 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:14:28 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:28 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.553s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:28 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:28 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] Deleted volume successfully. Sep 28 17:14:28 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0b99baee-14fb-4a50-afa9-e7d7bcbf549e tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-cf8711c3-f9c2-46cf-a843-38f85e05944d-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Flow 'volume_create_manager' (c3b74301-59f9-4945-bba7-674650f0f5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac4c509d-3d79-4b32-89a5-853c6c1ad662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac4c509d-3d79-4b32-89a5-853c6c1ad662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1722753398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b017c0-921c-41e7-84b1-12f800451a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2165e596dd410eb6640da78bd45a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:30Z,use_quota=True,user_id='69b217116aca432c93cde73cd85e40f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d36233-2596-475f-9e55-343cfc8a5e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d36233-2596-475f-9e55-343cfc8a5e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9813c198-b49b-476e-bd95-bdb59e230e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9813c198-b49b-476e-bd95-bdb59e230e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b017c0-921c-41e7-84b1-12f800451a4b', 'volume_name': 'volume-52b017c0-921c-41e7-84b1-12f800451a4b', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e192c421-10a4-4381-a903-76798f456f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e192c421-10a4-4381-a903-76798f456f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efebee2c-5027-4490-a524-2ae36a9dd8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:29 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Volume 52b017c0-921c-41e7-84b1-12f800451a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b017c0-921c-41e7-84b1-12f800451a4b', 'volume_size': 1} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1722753398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b017c0-921c-41e7-84b1-12f800451a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2165e596dd410eb6640da78bd45a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:30Z,use_quota=True,user_id='69b217116aca432c93cde73cd85e40f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Creating volume 52b017c0-921c-41e7-84b1-12f800451a4b {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:29 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:14:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:29 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b 1073741824 Sep 28 17:14:29 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:30 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b 1073741824" returned: 0 in 0.717s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:30 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b Sep 28 17:14:30 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:31 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b" returned: 0 in 0.492s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efebee2c-5027-4490-a524-2ae36a9dd8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b017c0-921c-41e7-84b1-12f800451a4b', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852ebaec-1d3c-416e-9a3f-1583b323a690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Flow 'volume_create_manager' (0f788edf-0506-4519-9378-3873aedf019f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a90935-6677-4422-8868-e8b396fcebd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:31 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Volume volume-52b017c0-921c-41e7-84b1-12f800451a4b (52b017c0-921c-41e7-84b1-12f800451a4b): created successfully Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852ebaec-1d3c-416e-9a3f-1583b323a690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Flow 'volume_create_manager' (c3b74301-59f9-4945-bba7-674650f0f5a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a90935-6677-4422-8868-e8b396fcebd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-903046915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=def6904b-bda4-426a-aca6-933fd9bba60e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e725caa0b8424889a2d447cdb5df8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:31Z,use_quota=True,user_id='fab1d40274b54cefa288fae471c350ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a912c46e-8261-454d-a32b-e4df32e71dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a912c46e-8261-454d-a32b-e4df32e71dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ed2981-6d0d-4f96-a754-87df63f6d6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ed2981-6d0d-4f96-a754-87df63f6d6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'def6904b-bda4-426a-aca6-933fd9bba60e', 'volume_name': 'volume-def6904b-bda4-426a-aca6-933fd9bba60e', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3f9af4-f707-42aa-854f-6fc4902082a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3f9af4-f707-42aa-854f-6fc4902082a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64bed07e-f823-4047-919c-6af00ea06f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:31 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Volume def6904b-bda4-426a-aca6-933fd9bba60e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-def6904b-bda4-426a-aca6-933fd9bba60e', 'volume_size': 1} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-903046915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=def6904b-bda4-426a-aca6-933fd9bba60e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e725caa0b8424889a2d447cdb5df8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:31Z,use_quota=True,user_id='fab1d40274b54cefa288fae471c350ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Creating volume def6904b-bda4-426a-aca6-933fd9bba60e {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:31 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:14:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-def6904b-bda4-426a-aca6-933fd9bba60e 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:31 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-f62a5509-d7d2-4a33-afff-4b60f3998099 tempest-VolumesSnapshotTestJSON-717735650 None] Created volume successfully. Sep 28 17:14:31 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-def6904b-bda4-426a-aca6-933fd9bba60e 1073741824 Sep 28 17:14:31 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Flow 'volume_create_manager' (e3f43c84-c300-4623-8918-05cf915f14c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172d2b16-f393-45f9-a22b-4c282562694f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:32 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-def6904b-bda4-426a-aca6-933fd9bba60e 1073741824" returned: 0 in 0.854s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172d2b16-f393-45f9-a22b-4c282562694f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1036940050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd031ba-3133-4751-b35f-fc901956b99d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e725caa0b8424889a2d447cdb5df8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:32Z,use_quota=True,user_id='fab1d40274b54cefa288fae471c350ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c35b446-4586-4ea5-9c97-f1c6c9453d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c35b446-4586-4ea5-9c97-f1c6c9453d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6a6ce4-1f9a-45e3-a89d-41d981db296e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6a6ce4-1f9a-45e3-a89d-41d981db296e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd031ba-3133-4751-b35f-fc901956b99d', 'volume_name': 'volume-4cd031ba-3133-4751-b35f-fc901956b99d', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51b325e-5dec-404b-ac02-2284b6e8719b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51b325e-5dec-404b-ac02-2284b6e8719b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3bbd07d-2269-46ad-bf98-02ebc31831eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:32 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Volume 4cd031ba-3133-4751-b35f-fc901956b99d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd031ba-3133-4751-b35f-fc901956b99d', 'volume_size': 1} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-def6904b-bda4-426a-aca6-933fd9bba60e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:32 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-def6904b-bda4-426a-aca6-933fd9bba60e Sep 28 17:14:32 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:32 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Flow 'volume_create_manager' (b694de20-43b8-43bc-abc8-a97221de671a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca1958e-ce9c-4700-aa67-4010c16464bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-def6904b-bda4-426a-aca6-933fd9bba60e" returned: 0 in 0.418s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.508s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1036940050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd031ba-3133-4751-b35f-fc901956b99d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e725caa0b8424889a2d447cdb5df8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:32Z,use_quota=True,user_id='fab1d40274b54cefa288fae471c350ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Creating volume 4cd031ba-3133-4751-b35f-fc901956b99d {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:32 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4cd031ba-3133-4751-b35f-fc901956b99d 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:32 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4cd031ba-3133-4751-b35f-fc901956b99d 1073741824 Sep 28 17:14:32 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca1958e-ce9c-4700-aa67-4010c16464bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-486195853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50411d57-9c54-4a6a-a96b-03bf78872109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e725caa0b8424889a2d447cdb5df8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:33Z,use_quota=True,user_id='fab1d40274b54cefa288fae471c350ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c7d165-e5b8-48a6-abc7-0ad521e516a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c7d165-e5b8-48a6-abc7-0ad521e516a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea353bcf-76c2-4893-8f52-13b73d291d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea353bcf-76c2-4893-8f52-13b73d291d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50411d57-9c54-4a6a-a96b-03bf78872109', 'volume_name': 'volume-50411d57-9c54-4a6a-a96b-03bf78872109', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6c1727-46bd-46f9-ba58-cd8f068144d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6c1727-46bd-46f9-ba58-cd8f068144d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4313f37f-6525-4e0a-b7f8-b2f35358e76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:33 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Volume 50411d57-9c54-4a6a-a96b-03bf78872109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50411d57-9c54-4a6a-a96b-03bf78872109', 'volume_size': 1} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64bed07e-f823-4047-919c-6af00ea06f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-def6904b-bda4-426a-aca6-933fd9bba60e', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48d4326-2c59-4dd4-b5d3-b0030c2519ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:33 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Volume volume-def6904b-bda4-426a-aca6-933fd9bba60e (def6904b-bda4-426a-aca6-933fd9bba60e): created successfully Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48d4326-2c59-4dd4-b5d3-b0030c2519ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Flow 'volume_create_manager' (0f788edf-0506-4519-9378-3873aedf019f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:33 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-832d920e-92a2-44b9-9645-1983d54a506f tempest-CreateVolumesFromImageTest-78325233 None] Created volume successfully. Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Flow 'volume_create_manager' (c3aa2068-d430-4056-8fa4-99556f8ade85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506c26d2-2182-48b7-a0bb-c9623753a492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506c26d2-2182-48b7-a0bb-c9623753a492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-674551306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c77153-6c87-40a3-bb48-c6340c8e29cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e725caa0b8424889a2d447cdb5df8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:34Z,use_quota=True,user_id='fab1d40274b54cefa288fae471c350ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d10fece-3827-434e-8e68-1c8d945660ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d10fece-3827-434e-8e68-1c8d945660ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddbb525-4686-4eb5-9357-d4d724f6cba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddbb525-4686-4eb5-9357-d4d724f6cba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c77153-6c87-40a3-bb48-c6340c8e29cb', 'volume_name': 'volume-61c77153-6c87-40a3-bb48-c6340c8e29cb', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ced0c7-3324-4da7-b43b-c8d1b9dde5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ced0c7-3324-4da7-b43b-c8d1b9dde5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:33 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779835e3-8561-42fa-b1fb-a048b3788e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:33 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Volume 61c77153-6c87-40a3-bb48-c6340c8e29cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c77153-6c87-40a3-bb48-c6340c8e29cb', 'volume_size': 1} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4cd031ba-3133-4751-b35f-fc901956b99d 1073741824" returned: 0 in 0.922s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4cd031ba-3133-4751-b35f-fc901956b99d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:33 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4cd031ba-3133-4751-b35f-fc901956b99d Sep 28 17:14:33 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Flow 'volume_create_manager' (9028633b-c996-4cc8-8022-e42696c4e4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe583ab-150a-42e2-bb7e-29892877a069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe583ab-150a-42e2-bb7e-29892877a069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1205344799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e025147c-b27c-4c31-a4ec-575c03a3d920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e725caa0b8424889a2d447cdb5df8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:34Z,use_quota=True,user_id='fab1d40274b54cefa288fae471c350ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab443ac1-d55c-4c0b-96ab-29bdc00c40dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab443ac1-d55c-4c0b-96ab-29bdc00c40dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77671e7-c266-4dde-8f2d-02db0a3b2e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77671e7-c266-4dde-8f2d-02db0a3b2e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e025147c-b27c-4c31-a4ec-575c03a3d920', 'volume_name': 'volume-e025147c-b27c-4c31-a4ec-575c03a3d920', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c640f7e6-8c68-4879-9303-03cdf978a49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c640f7e6-8c68-4879-9303-03cdf978a49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cc8424-fc33-4ccf-bb12-5116bfdf094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:34 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Volume e025147c-b27c-4c31-a4ec-575c03a3d920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e025147c-b27c-4c31-a4ec-575c03a3d920', 'volume_size': 1} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:34 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4cd031ba-3133-4751-b35f-fc901956b99d" returned: 0 in 0.407s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.895s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3bbd07d-2269-46ad-bf98-02ebc31831eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd031ba-3133-4751-b35f-fc901956b99d', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6d2b09-80df-40b5-9a11-1f0323e47e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] Creating offline snapshot b53fc753-33ec-41fd-825a-28616e4d079d of volume 52b017c0-921c-41e7-84b1-12f800451a4b {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:14:34 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Volume volume-4cd031ba-3133-4751-b35f-fc901956b99d (4cd031ba-3133-4751-b35f-fc901956b99d): created successfully Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6d2b09-80df-40b5-9a11-1f0323e47e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Flow 'volume_create_manager' (e3f43c84-c300-4623-8918-05cf915f14c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef4d786-31a5-488a-9564-569784056452]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:34 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2bef926f-ce1b-4dd2-adac-85c91e7ef1bb tempest-CreateVolumesFromImageTest-78325233 None] Created volume successfully. Sep 28 17:14:34 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b Sep 28 17:14:34 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:34 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b" returned: 0 in 0.472s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:34 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d 1G Sep 28 17:14:34 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:35 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d 1G" returned: 0 in 0.652s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b017c0-921c-41e7-84b1-12f800451a4b -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:35 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b017c0-921c-41e7-84b1-12f800451a4b -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d Sep 28 17:14:35 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:35 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Flow 'volume_create_manager' (abc075ae-bf2f-4cf0-8eed-e6ecafb44087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b948baa8-55cf-4198-a93f-96a3e0b53c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b948baa8-55cf-4198-a93f-96a3e0b53c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1694512187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e264af-0473-4472-8b3c-55a4e9694bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9cf36da64d3457d8f9c7168e90b2544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:36Z,use_quota=True,user_id='95bb4c39cd6144c8b5df057b4f0e02d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c0f881-d7e1-4607-974b-663cdbfb8712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c0f881-d7e1-4607-974b-663cdbfb8712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3edd4d2-c278-477e-9eee-90511e75468b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:35 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3edd4d2-c278-477e-9eee-90511e75468b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35e264af-0473-4472-8b3c-55a4e9694bee', 'volume_name': 'volume-35e264af-0473-4472-8b3c-55a4e9694bee', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9727fd58-1dd0-4b04-83aa-6c37fe7990f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9727fd58-1dd0-4b04-83aa-6c37fe7990f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c6a663-bb9c-4a1f-abd8-d912af1de60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:35 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Volume 35e264af-0473-4472-8b3c-55a4e9694bee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35e264af-0473-4472-8b3c-55a4e9694bee', 'volume_size': 1} Sep 28 17:14:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b017c0-921c-41e7-84b1-12f800451a4b -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d" returned: 0 in 0.425s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:35 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d is being set with open permissions: ugo+rw Sep 28 17:14:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:35 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d Sep 28 17:14:35 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:36 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d" returned: 0 in 0.346s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:36 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.info Sep 28 17:14:36 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:36 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.info" returned: 0 in 0.321s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:36 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.info is being set with open permissions: ugo+rw Sep 28 17:14:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:36 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.info Sep 28 17:14:36 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:36 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.info" returned: 0 in 0.271s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.626s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.816s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-486195853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50411d57-9c54-4a6a-a96b-03bf78872109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e725caa0b8424889a2d447cdb5df8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:33Z,use_quota=True,user_id='fab1d40274b54cefa288fae471c350ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Creating volume 50411d57-9c54-4a6a-a96b-03bf78872109 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:36 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:14:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-50411d57-9c54-4a6a-a96b-03bf78872109 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:37 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-50411d57-9c54-4a6a-a96b-03bf78872109 1073741824 Sep 28 17:14:37 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:37 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-830a1200-2951-41f7-a6d3-e9de7768f8e2 tempest-VolumesSnapshotTestJSON-717735650 None] Create snapshot completed successfully Sep 28 17:14:37 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-50411d57-9c54-4a6a-a96b-03bf78872109 1073741824" returned: 0 in 0.531s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-50411d57-9c54-4a6a-a96b-03bf78872109 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:37 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-50411d57-9c54-4a6a-a96b-03bf78872109 Sep 28 17:14:37 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:37 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-50411d57-9c54-4a6a-a96b-03bf78872109" returned: 0 in 0.349s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.065s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-674551306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c77153-6c87-40a3-bb48-c6340c8e29cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e725caa0b8424889a2d447cdb5df8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:34Z,use_quota=True,user_id='fab1d40274b54cefa288fae471c350ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Creating volume 61c77153-6c87-40a3-bb48-c6340c8e29cb {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:37 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-61c77153-6c87-40a3-bb48-c6340c8e29cb 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4313f37f-6525-4e0a-b7f8-b2f35358e76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50411d57-9c54-4a6a-a96b-03bf78872109', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec816aa-ee3a-4211-bced-07e69f2562b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:37 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-61c77153-6c87-40a3-bb48-c6340c8e29cb 1073741824 Sep 28 17:14:37 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:37 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Volume volume-50411d57-9c54-4a6a-a96b-03bf78872109 (50411d57-9c54-4a6a-a96b-03bf78872109): created successfully Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec816aa-ee3a-4211-bced-07e69f2562b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Flow 'volume_create_manager' (b694de20-43b8-43bc-abc8-a97221de671a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:38 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-f7b9d69c-5345-4636-aafc-c319d4c8b2bb tempest-CreateVolumesFromImageTest-78325233 None] Created volume successfully. Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Flow 'volume_create_manager' (b81a4653-d961-40d4-b1a9-e53cb3c26bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee8e5d3-2924-4d00-989d-424f56d5acbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:38 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee8e5d3-2924-4d00-989d-424f56d5acbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1609128795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafa38f7-1301-4eab-a56d-b4af51891a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2165e596dd410eb6640da78bd45a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b53fc753-33ec-41fd-825a-28616e4d079d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:38Z,use_quota=True,user_id='69b217116aca432c93cde73cd85e40f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97a076b-feb8-4df3-9d77-b7a24c6c60d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97a076b-feb8-4df3-9d77-b7a24c6c60d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c28957-c981-4ba4-8a87-6df716f9f565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c28957-c981-4ba4-8a87-6df716f9f565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dafa38f7-1301-4eab-a56d-b4af51891a4d', 'volume_name': 'volume-dafa38f7-1301-4eab-a56d-b4af51891a4d', 'volume_size': 1, 'snapshot_id': 'b53fc753-33ec-41fd-825a-28616e4d079d'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4108dcd-19fa-42d1-8d23-5a7145e29905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4108dcd-19fa-42d1-8d23-5a7145e29905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb357eff-1fe4-4e19-b4da-26673cef257c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:38 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Volume dafa38f7-1301-4eab-a56d-b4af51891a4d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dafa38f7-1301-4eab-a56d-b4af51891a4d', 'volume_size': 1, 'snapshot_id': 'b53fc753-33ec-41fd-825a-28616e4d079d'} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-61c77153-6c87-40a3-bb48-c6340c8e29cb 1073741824" returned: 0 in 0.717s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-61c77153-6c87-40a3-bb48-c6340c8e29cb {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:38 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-61c77153-6c87-40a3-bb48-c6340c8e29cb Sep 28 17:14:38 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:38 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-61c77153-6c87-40a3-bb48-c6340c8e29cb" returned: 0 in 0.302s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.734s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1205344799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e025147c-b27c-4c31-a4ec-575c03a3d920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e725caa0b8424889a2d447cdb5df8150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:34Z,use_quota=True,user_id='fab1d40274b54cefa288fae471c350ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Creating volume e025147c-b27c-4c31-a4ec-575c03a3d920 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:39 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e025147c-b27c-4c31-a4ec-575c03a3d920 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779835e3-8561-42fa-b1fb-a048b3788e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c77153-6c87-40a3-bb48-c6340c8e29cb', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:39 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e025147c-b27c-4c31-a4ec-575c03a3d920 1073741824 Sep 28 17:14:39 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc54a52b-1271-4a90-9411-5d25edc9c9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:39 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Volume volume-61c77153-6c87-40a3-bb48-c6340c8e29cb (61c77153-6c87-40a3-bb48-c6340c8e29cb): created successfully Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc54a52b-1271-4a90-9411-5d25edc9c9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Flow 'volume_create_manager' (c3aa2068-d430-4056-8fa4-99556f8ade85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:39 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a454e170-3227-451a-b34c-32c1a0cea337 tempest-CreateVolumesFromImageTest-78325233 None] Created volume successfully. Sep 28 17:14:39 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e025147c-b27c-4c31-a4ec-575c03a3d920 1073741824" returned: 0 in 0.570s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e025147c-b27c-4c31-a4ec-575c03a3d920 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:39 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e025147c-b27c-4c31-a4ec-575c03a3d920 Sep 28 17:14:39 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:39 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] Acquiring lock "cinder-ac062531-e423-4d69-b9eb-ff29c40cf11c-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e025147c-b27c-4c31-a4ec-575c03a3d920" returned: 0 in 0.350s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.029s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1694512187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e264af-0473-4472-8b3c-55a4e9694bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9cf36da64d3457d8f9c7168e90b2544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:36Z,use_quota=True,user_id='95bb4c39cd6144c8b5df057b4f0e02d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Creating volume 35e264af-0473-4472-8b3c-55a4e9694bee {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:39 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:14:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:40 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee 1073741824 Sep 28 17:14:40 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cc8424-fc33-4ccf-bb12-5116bfdf094f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e025147c-b27c-4c31-a4ec-575c03a3d920', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f63989-f923-4535-9884-61938a37c141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] Lock "cinder-ac062531-e423-4d69-b9eb-ff29c40cf11c-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:40 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Volume volume-e025147c-b27c-4c31-a4ec-575c03a3d920 (e025147c-b27c-4c31-a4ec-575c03a3d920): created successfully Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f63989-f923-4535-9884-61938a37c141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Flow 'volume_create_manager' (9028633b-c996-4cc8-8022-e42696c4e4c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:40 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-588ce2d2-a945-4327-9fc9-1f001cb95a69 tempest-CreateVolumesFromImageTest-78325233 None] Created volume successfully. Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] Acquiring lock "cinder-quobyte-ac062531-e423-4d69-b9eb-ff29c40cf11c" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] Lock "cinder-quobyte-ac062531-e423-4d69-b9eb-ff29c40cf11c" acquired by "delete_volume" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[357de643-5a81-4bd5-8149-097bbdcca781]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ac062531-e423-4d69-b9eb-ff29c40cf11c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:40 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ac062531-e423-4d69-b9eb-ff29c40cf11c Sep 28 17:14:40 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:40 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee 1073741824" returned: 0 in 0.597s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:40 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:40 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ac062531-e423-4d69-b9eb-ff29c40cf11c" returned: 0 in 0.474s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ac062531-e423-4d69-b9eb-ff29c40cf11c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:40 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:40 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ac062531-e423-4d69-b9eb-ff29c40cf11c Sep 28 17:14:40 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:40 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "cinder-e025147c-b27c-4c31-a4ec-575c03a3d920-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee" returned: 0 in 0.313s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.313s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-quobyte-b53fc753-33ec-41fd-825a-28616e4d079d-dafa38f7-1301-4eab-a56d-b4af51891a4d" by "_create_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c6a663-bb9c-4a1f-abd8-d912af1de60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e264af-0473-4472-8b3c-55a4e9694bee', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390ab838-a164-41eb-a953-fdffc0b5f5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-e025147c-b27c-4c31-a4ec-575c03a3d920-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:41 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Volume volume-35e264af-0473-4472-8b3c-55a4e9694bee (35e264af-0473-4472-8b3c-55a4e9694bee): created successfully Sep 28 17:14:41 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390ab838-a164-41eb-a953-fdffc0b5f5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Flow 'volume_create_manager' (abc075ae-bf2f-4cf0-8eed-e6ecafb44087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-b53fc753-33ec-41fd-825a-28616e4d079d-dafa38f7-1301-4eab-a56d-b4af51891a4d" acquired by "_create_volume_from_snapshot" :: waited 0.072s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Creating volume dafa38f7-1301-4eab-a56d-b4af51891a4d from snapshot b53fc753-33ec-41fd-825a-28616e4d079d {{(pid=86970) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-quobyte-dafa38f7-1301-4eab-a56d-b4af51891a4d" by "_copy_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ac062531-e423-4d69-b9eb-ff29c40cf11c" returned: 0 in 0.391s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:41 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-9fcf93aa-0a97-439b-8550-14bcedccc541 tempest-VolumesCloneTest-1596688712 None] Created volume successfully. Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] Lock "cinder-quobyte-ac062531-e423-4d69-b9eb-ff29c40cf11c" released by "delete_volume" :: held 0.922s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-dafa38f7-1301-4eab-a56d-b4af51891a4d" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] snapshot: b53fc753-33ec-41fd-825a-28616e4d079d, volume: dafa38f7-1301-4eab-a56d-b4af51891a4d, {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "cinder-quobyte-e025147c-b27c-4c31-a4ec-575c03a3d920" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-quobyte-e025147c-b27c-4c31-a4ec-575c03a3d920" acquired by "delete_volume" :: waited 0.116s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[974f0d9c-c29b-4493-a2f1-6bbd92345c56]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a009da-66d3-4d9d-8429-40ffc7b88fed]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e025147c-b27c-4c31-a4ec-575c03a3d920 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] Created reservations ['2b118ad6-9b80-488f-9808-ddeead29cc43', 'd8443624-d364-4225-8372-aeee4e097018', '6a22a935-c6b7-4b66-a696-c4708cdc8561', '8d7f7af2-2be7-4218-bddf-f1b2abe50582'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:41 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d Sep 28 17:14:41 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:41 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e025147c-b27c-4c31-a4ec-575c03a3d920 Sep 28 17:14:41 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:41 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:14:41 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:41 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d" returned: 0 in 0.522s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b017c0-921c-41e7-84b1-12f800451a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[700f0623-1f5b-48d0-b2e4-a1d573b38352]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:41 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e025147c-b27c-4c31-a4ec-575c03a3d920" returned: 0 in 0.569s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e025147c-b27c-4c31-a4ec-575c03a3d920 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:41 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.444s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:41 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:41 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e025147c-b27c-4c31-a4ec-575c03a3d920 Sep 28 17:14:41 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] Deleted volume successfully. Sep 28 17:14:41 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-31078797-4eba-43cb-98ef-fdf202981119 tempest-VolumesNegativeTest-1135291177 None] Lock "cinder-ac062531-e423-4d69-b9eb-ff29c40cf11c-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:42 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b Sep 28 17:14:42 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Flow 'volume_create_manager' (42364d96-eb53-4a53-ad4e-928621f7879f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706ed9de-b9e3-46ee-a0a1-c9c2e8106215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706ed9de-b9e3-46ee-a0a1-c9c2e8106215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1345765225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48af10c-0215-4e8a-b5be-10cc130f7135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9cf36da64d3457d8f9c7168e90b2544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=35e264af-0473-4472-8b3c-55a4e9694bee,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:42Z,use_quota=True,user_id='95bb4c39cd6144c8b5df057b4f0e02d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08580cd6-cbb9-44b7-b95a-acaa2ac3c804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08580cd6-cbb9-44b7-b95a-acaa2ac3c804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5525985d-3a78-4f39-9801-80917c1c3485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5525985d-3a78-4f39-9801-80917c1c3485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e48af10c-0215-4e8a-b5be-10cc130f7135', 'volume_name': 'volume-e48af10c-0215-4e8a-b5be-10cc130f7135', 'volume_size': 2, 'source_volid': '35e264af-0473-4472-8b3c-55a4e9694bee', 'source_volstatus': 'available'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66897ecb-34da-4b3a-8a37-e7f924fd5583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66897ecb-34da-4b3a-8a37-e7f924fd5583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034442f7-5d8e-4256-ab85-1ece5bf37c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:42 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Volume e48af10c-0215-4e8a-b5be-10cc130f7135: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e48af10c-0215-4e8a-b5be-10cc130f7135', 'volume_size': 2, 'source_volid': '35e264af-0473-4472-8b3c-55a4e9694bee', 'source_volstatus': 'available'} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:42 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e025147c-b27c-4c31-a4ec-575c03a3d920" returned: 0 in 0.417s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-quobyte-e025147c-b27c-4c31-a4ec-575c03a3d920" released by "delete_volume" :: held 1.041s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:42 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] Created reservations ['069ce2bd-d6c3-41e4-afd6-afc6ca8039a3', 'c8707f4e-e1ca-4db4-a8d1-bb05e5c54139', 'cefafcd0-0059-462f-be36-bc446534d218', 'f05e7c98-7ecb-4ecc-bcc5-7ddadd0240f1'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b" returned: 0 in 0.535s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Creating direct copy from snapshot {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.utils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Path /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dafa38f7-1301-4eab-a56d-b4af51891a4d not found in is_blk_device check {{(pid=86970) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dafa38f7-1301-4eab-a56d-b4af51891a4d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:42 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dafa38f7-1301-4eab-a56d-b4af51891a4d Sep 28 17:14:42 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:42 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:14:42 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:42 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.315s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:42 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] Deleted volume successfully. Sep 28 17:14:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-70b5d614-02b8-4e85-ae05-f615579fc3d0 tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-e025147c-b27c-4c31-a4ec-575c03a3d920-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "cinder-61c77153-6c87-40a3-bb48-c6340c8e29cb-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-61c77153-6c87-40a3-bb48-c6340c8e29cb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "cinder-quobyte-61c77153-6c87-40a3-bb48-c6340c8e29cb" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-quobyte-61c77153-6c87-40a3-bb48-c6340c8e29cb" acquired by "delete_volume" :: waited 0.060s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:43 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[efafa6bf-4074-493a-910c-13e3b8e1548b]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-61c77153-6c87-40a3-bb48-c6340c8e29cb {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:43 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-61c77153-6c87-40a3-bb48-c6340c8e29cb Sep 28 17:14:43 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:44 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-61c77153-6c87-40a3-bb48-c6340c8e29cb" returned: 0 in 0.942s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-61c77153-6c87-40a3-bb48-c6340c8e29cb {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:44 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-61c77153-6c87-40a3-bb48-c6340c8e29cb Sep 28 17:14:44 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:45 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-61c77153-6c87-40a3-bb48-c6340c8e29cb" returned: 0 in 0.558s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-quobyte-61c77153-6c87-40a3-bb48-c6340c8e29cb" released by "delete_volume" :: held 1.629s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:45 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] Created reservations ['20d78759-288c-476e-b4da-36f1345e80a0', 'f780287c-c7c2-4172-8e88-577656b14071', '28b14008-3ab2-46a1-b3cc-1266d370ee8c', 'be0a6fee-013e-4fad-8605-7e67f0caa47b'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:45 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:45 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:45 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:14:45 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "cinder-50411d57-9c54-4a6a-a96b-03bf78872109-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-50411d57-9c54-4a6a-a96b-03bf78872109-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:46 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.573s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:46 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:46 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] Deleted volume successfully. Sep 28 17:14:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "cinder-quobyte-50411d57-9c54-4a6a-a96b-03bf78872109" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-quobyte-50411d57-9c54-4a6a-a96b-03bf78872109" acquired by "delete_volume" :: waited 0.067s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5d49f638-5574-4ae4-9c08-868abb74d816 tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-61c77153-6c87-40a3-bb48-c6340c8e29cb-delete_volume" released by "delete_volume" :: held 2.954s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:46 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eb69ce-99dd-42cc-81c1-9d805170827c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-50411d57-9c54-4a6a-a96b-03bf78872109 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:46 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-50411d57-9c54-4a6a-a96b-03bf78872109 Sep 28 17:14:46 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:47 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-50411d57-9c54-4a6a-a96b-03bf78872109" returned: 0 in 0.717s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-50411d57-9c54-4a6a-a96b-03bf78872109 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:47 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-50411d57-9c54-4a6a-a96b-03bf78872109 Sep 28 17:14:47 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:47 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-50411d57-9c54-4a6a-a96b-03bf78872109" returned: 0 in 0.510s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-quobyte-50411d57-9c54-4a6a-a96b-03bf78872109" released by "delete_volume" :: held 1.385s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:47 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] Created reservations ['edf7e4e7-971d-4ce1-b29e-4b9586965302', '40cbcfe6-e057-4a4b-ad99-59157d1d24ea', '011616ee-4219-41b2-8104-bbc76e877f90', '26186ffb-9111-4023-9a2f-f1ed0ac41fa2'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:47 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:47 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:48 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:14:48 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:48 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "cinder-4cd031ba-3133-4751-b35f-fc901956b99d-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:48 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-4cd031ba-3133-4751-b35f-fc901956b99d-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:48 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:48 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "cinder-quobyte-4cd031ba-3133-4751-b35f-fc901956b99d" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.763s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:48 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:48 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] Deleted volume successfully. Sep 28 17:14:48 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-quobyte-4cd031ba-3133-4751-b35f-fc901956b99d" acquired by "delete_volume" :: waited 0.082s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:48 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9323418a-85ae-41b4-82d1-738a8a73e9da tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-50411d57-9c54-4a6a-a96b-03bf78872109-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:48 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0968981-41db-4583-9e5c-60f76ecea41c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4cd031ba-3133-4751-b35f-fc901956b99d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:49 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4cd031ba-3133-4751-b35f-fc901956b99d Sep 28 17:14:49 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:49 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4cd031ba-3133-4751-b35f-fc901956b99d" returned: 0 in 0.785s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4cd031ba-3133-4751-b35f-fc901956b99d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:49 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4cd031ba-3133-4751-b35f-fc901956b99d Sep 28 17:14:49 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:50 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4cd031ba-3133-4751-b35f-fc901956b99d" returned: 0 in 0.585s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-quobyte-4cd031ba-3133-4751-b35f-fc901956b99d" released by "delete_volume" :: held 1.494s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:50 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] Created reservations ['ac78df3d-2dbc-492a-82af-c9d6d8b3a77c', '2d8c8b5d-9aed-4d84-9d5a-182fa46ef1ea', '6527bf23-f0b1-4aed-8842-a89ccb5fab2e', 'd1b8c20e-b3f1-418a-bed6-6d1b80b9801f'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:50 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:14:50 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:51 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "cinder-def6904b-bda4-426a-aca6-933fd9bba60e-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:51 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-def6904b-bda4-426a-aca6-933fd9bba60e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:51 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:51 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "cinder-quobyte-def6904b-bda4-426a-aca6-933fd9bba60e" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.823s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:51 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:51 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] Deleted volume successfully. Sep 28 17:14:51 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-quobyte-def6904b-bda4-426a-aca6-933fd9bba60e" acquired by "delete_volume" :: waited 0.052s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:51 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-af1ef346-bab2-4248-a208-ec8ff708a803 tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-4cd031ba-3133-4751-b35f-fc901956b99d-delete_volume" released by "delete_volume" :: held 2.954s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:51 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[662cf24f-bb11-4e3b-a931-34dcab74faa9]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-def6904b-bda4-426a-aca6-933fd9bba60e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:51 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dafa38f7-1301-4eab-a56d-b4af51891a4d" returned: 0 in 9.311s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:51 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Image conversion details: src /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b, size 1024.00 MB, duration 9.31 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dafa38f7-1301-4eab-a56d-b4af51891a4d {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:14:51 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Converted 1024.00 MB image at 109.95 MB/s Sep 28 17:14:51 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dafa38f7-1301-4eab-a56d-b4af51891a4d is being set with open permissions: ugo+rw Sep 28 17:14:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dafa38f7-1301-4eab-a56d-b4af51891a4d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:51 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dafa38f7-1301-4eab-a56d-b4af51891a4d Sep 28 17:14:51 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:51 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-def6904b-bda4-426a-aca6-933fd9bba60e Sep 28 17:14:51 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:52 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dafa38f7-1301-4eab-a56d-b4af51891a4d" returned: 0 in 0.353s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-dafa38f7-1301-4eab-a56d-b4af51891a4d" released by "_copy_volume_from_snapshot" :: held 11.005s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:52 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-def6904b-bda4-426a-aca6-933fd9bba60e" returned: 0 in 0.521s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-def6904b-bda4-426a-aca6-933fd9bba60e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:52 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-def6904b-bda4-426a-aca6-933fd9bba60e Sep 28 17:14:52 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-b53fc753-33ec-41fd-825a-28616e4d079d-dafa38f7-1301-4eab-a56d-b4af51891a4d" released by "_create_volume_from_snapshot" :: held 11.134s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.210s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.873s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:52 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Cloning volume 35e264af-0473-4472-8b3c-55a4e9694bee to volume e48af10c-0215-4e8a-b5be-10cc130f7135 Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb357eff-1fe4-4e19-b4da-26673cef257c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dafa38f7-1301-4eab-a56d-b4af51891a4d', 'volume_size': 1, 'snapshot_id': 'b53fc753-33ec-41fd-825a-28616e4d079d'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6746199c-3e5c-4ebb-9638-0080980b4ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Creating offline snapshot f66312e6-54db-4d2f-9eec-442d3b15f8a5 of volume 35e264af-0473-4472-8b3c-55a4e9694bee {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:14:52 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Volume volume-dafa38f7-1301-4eab-a56d-b4af51891a4d (dafa38f7-1301-4eab-a56d-b4af51891a4d): created successfully Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6746199c-3e5c-4ebb-9638-0080980b4ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Flow 'volume_create_manager' (b81a4653-d961-40d4-b1a9-e53cb3c26bd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8d7962-9ab1-4365-96cc-c3e70cf982ae]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:52 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-79df8364-0d9f-4946-98bd-11c36c50a30a tempest-VolumesSnapshotTestJSON-717735650 None] Created volume successfully. Sep 28 17:14:52 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-def6904b-bda4-426a-aca6-933fd9bba60e" returned: 0 in 0.357s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-quobyte-def6904b-bda4-426a-aca6-933fd9bba60e" released by "delete_volume" :: held 0.972s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:52 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee Sep 28 17:14:52 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] Created reservations ['7648213e-37f9-4004-8d53-71d2d774ea01', '92d12fc5-a72f-4641-b6b6-abc13b0c439a', '3b37a6a8-5b27-4154-bf54-28e59d2f6074', '742db62d-1852-4265-a2af-e2e99419452b'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:52 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:14:52 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:52 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee" returned: 0 in 0.704s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:53 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5 1G Sep 28 17:14:53 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:53 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.404s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:53 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:53 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] Deleted volume successfully. Sep 28 17:14:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-66cb5452-7284-4065-ab6c-0b31944e866f tempest-CreateVolumesFromImageTest-78325233 None] Lock "cinder-def6904b-bda4-426a-aca6-933fd9bba60e-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-dafa38f7-1301-4eab-a56d-b4af51891a4d-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-dafa38f7-1301-4eab-a56d-b4af51891a4d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-quobyte-dafa38f7-1301-4eab-a56d-b4af51891a4d" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-dafa38f7-1301-4eab-a56d-b4af51891a4d" acquired by "delete_volume" :: waited 0.022s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:53 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e24afc-404c-4d8c-932a-a0486e3b5fa5]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dafa38f7-1301-4eab-a56d-b4af51891a4d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:53 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dafa38f7-1301-4eab-a56d-b4af51891a4d Sep 28 17:14:53 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:53 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5 1G" returned: 0 in 0.672s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35e264af-0473-4472-8b3c-55a4e9694bee -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:53 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35e264af-0473-4472-8b3c-55a4e9694bee -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5 Sep 28 17:14:53 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:53 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dafa38f7-1301-4eab-a56d-b4af51891a4d" returned: 0 in 0.544s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dafa38f7-1301-4eab-a56d-b4af51891a4d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:54 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dafa38f7-1301-4eab-a56d-b4af51891a4d Sep 28 17:14:54 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:54 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35e264af-0473-4472-8b3c-55a4e9694bee -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5" returned: 0 in 0.493s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:54 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5 is being set with open permissions: ugo+rw Sep 28 17:14:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:54 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5 Sep 28 17:14:54 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:54 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-dafa38f7-1301-4eab-a56d-b4af51891a4d" returned: 0 in 0.408s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-dafa38f7-1301-4eab-a56d-b4af51891a4d" released by "delete_volume" :: held 1.028s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:54 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] Created reservations ['942dc145-3604-4f86-8fb4-3be440271414', '3e92c03f-62df-4d05-a448-57b192d8ec14', 'e4ad61d6-52ad-4024-8b76-b2000c1034f3', 'aa7e6824-5e14-4b40-9b3b-d842d05aae66'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:54 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5" returned: 0 in 0.451s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:54 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.info Sep 28 17:14:54 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:54 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:14:54 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:55 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.info" returned: 0 in 0.458s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:55 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.info is being set with open permissions: ugo+rw Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:55 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.info Sep 28 17:14:55 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:55 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.430s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:55 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] Deleted volume successfully. Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-aed5a53e-1e6c-488a-8491-3ae01ebf9926 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-dafa38f7-1301-4eab-a56d-b4af51891a4d-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:55 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.info" returned: 0 in 0.397s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Acquiring lock "cinder-quobyte-e48af10c-0215-4e8a-b5be-10cc130f7135" by "_copy_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Lock "cinder-quobyte-e48af10c-0215-4e8a-b5be-10cc130f7135" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] snapshot: f66312e6-54db-4d2f-9eec-442d3b15f8a5, volume: e48af10c-0215-4e8a-b5be-10cc130f7135, {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[802f8402-03d4-4bcf-b12a-9769609206cf]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-b53fc753-33ec-41fd-825a-28616e4d079d-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-b53fc753-33ec-41fd-825a-28616e4d079d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-quobyte-52b017c0-921c-41e7-84b1-12f800451a4b" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-52b017c0-921c-41e7-84b1-12f800451a4b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-quobyte-b53fc753-33ec-41fd-825a-28616e4d079d" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-b53fc753-33ec-41fd-825a-28616e4d079d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] Deleting offline snapshot b53fc753-33ec-41fd-825a-28616e4d079d of volume 52b017c0-921c-41e7-84b1-12f800451a4b {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:14:55 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5 Sep 28 17:14:55 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] snapshot_file for this snap is: volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cbffe1-6dd8-4f26-8449-86fb2136cde4]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:56 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d Sep 28 17:14:56 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:56 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5" returned: 0 in 0.627s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35e264af-0473-4472-8b3c-55a4e9694bee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:56 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d08575-77f3-42e1-b09c-051fca5bac2d]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:56 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d" returned: 0 in 0.491s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b017c0-921c-41e7-84b1-12f800451a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:56 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[9566558c-e297-4749-8e72-6e5d4b1677f1]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:56 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee Sep 28 17:14:56 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:56 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b Sep 28 17:14:56 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:57 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee" returned: 0 in 1.033s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:14:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Creating direct copy from snapshot {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:14:57 devstack cinder-volume[86970]: DEBUG cinder.utils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Path /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e48af10c-0215-4e8a-b5be-10cc130f7135 not found in is_blk_device check {{(pid=86970) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:14:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e48af10c-0215-4e8a-b5be-10cc130f7135 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:57 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e48af10c-0215-4e8a-b5be-10cc130f7135 Sep 28 17:14:57 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:57 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b" returned: 0 in 1.019s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:57 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d Sep 28 17:14:57 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:58 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d" returned: 0 in 0.604s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:58 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d Sep 28 17:14:58 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:58 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b.b53fc753-33ec-41fd-825a-28616e4d079d" returned: 0 in 0.502s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-b53fc753-33ec-41fd-825a-28616e4d079d" released by "_delete_snapshot" :: held 2.952s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-52b017c0-921c-41e7-84b1-12f800451a4b" released by "delete_snapshot" :: held 2.995s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:59 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] Created reservations ['a8ccedea-00be-42f0-894f-c7fdab95db76', '54d7712b-d2a3-46b9-96b2-c901f0d01129', 'a853bfc5-6b98-46b5-a104-6ad196e1c686', '7a5da653-a946-46b6-be5c-4b9c2ce35802'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:59 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] Delete snapshot completed successfully. Sep 28 17:14:59 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-142b8da2-4d37-4f2b-a983-276eb70c763f tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-b53fc753-33ec-41fd-825a-28616e4d079d-delete_snapshot" released by "delete_snapshot" :: held 3.569s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Flow 'volume_create_manager' (18cca613-f853-49da-b5e4-b1e4fad01c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dee24a9-8f81-4490-9001-800467e4d84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dee24a9-8f81-4490-9001-800467e4d84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407096807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8739f3a-11e8-4ecc-90ed-938a76a76f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5ce5ee9c3b4852ba4b41a8723bb60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:00Z,use_quota=True,user_id='7c202e120ff84b2eaef3c54c45e66e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a2a8ae-56fd-4f71-ab80-cb94184729b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a2a8ae-56fd-4f71-ab80-cb94184729b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a72a9a-27fd-4fdf-a690-ba54de2fdec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a72a9a-27fd-4fdf-a690-ba54de2fdec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8739f3a-11e8-4ecc-90ed-938a76a76f79', 'volume_name': 'volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1da40be-6a06-47f1-a7c4-ead33db7009f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1da40be-6a06-47f1-a7c4-ead33db7009f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7307096-fa54-48de-9105-09c2a3893e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume c8739f3a-11e8-4ecc-90ed-938a76a76f79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79', 'volume_size': 1} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-52b017c0-921c-41e7-84b1-12f800451a4b-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-52b017c0-921c-41e7-84b1-12f800451a4b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-quobyte-52b017c0-921c-41e7-84b1-12f800451a4b" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-52b017c0-921c-41e7-84b1-12f800451a4b" acquired by "delete_volume" :: waited 0.055s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b9f05b-e2b9-434e-b842-0a6c2b57f67b]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:01 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b Sep 28 17:15:01 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:15:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:01 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:15:01 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:01 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b" returned: 0 in 0.726s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:01 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b Sep 28 17:15:01 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:01 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.692s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:15:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:15:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:15:02 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52b017c0-921c-41e7-84b1-12f800451a4b" returned: 0 in 0.727s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-52b017c0-921c-41e7-84b1-12f800451a4b" released by "delete_volume" :: held 1.684s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:02 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:UPDATE=149,cinder:SELECT=111,cinder:INSERT=40,cinder:DELETE=11 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:15:02 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=111,cinder:UPDATE=146,cinder:INSERT=32,cinder:DELETE=15 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:15:02 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] Created reservations ['3c0234ef-b9e8-460d-9973-99ce499a2679', 'b5667d7c-9d06-4ff0-ab19-5b187bc1bbab', 'c776f289-6003-4dc8-b636-6216294c9b23', '8b70ee7f-52d4-4098-a8ff-2be19382744f'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:02 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:15:02 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-eedc2b38-c9a4-4aa3-b63c-7402268d977c-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:03 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.604s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:03 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:03 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] Deleted volume successfully. Sep 28 17:15:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-eedc2b38-c9a4-4aa3-b63c-7402268d977c-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a9fed4dd-b43f-4779-ac43-235072c06983 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-52b017c0-921c-41e7-84b1-12f800451a4b-delete_volume" released by "delete_volume" :: held 2.950s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "cinder-quobyte-eedc2b38-c9a4-4aa3-b63c-7402268d977c" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-eedc2b38-c9a4-4aa3-b63c-7402268d977c" acquired by "delete_volume" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:03 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d0953e-3e43-4c80-8227-39ae0200999f]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:03 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c Sep 28 17:15:03 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:04 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c" returned: 0 in 0.949s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:04 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c Sep 28 17:15:04 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:05 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eedc2b38-c9a4-4aa3-b63c-7402268d977c" returned: 0 in 0.720s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-quobyte-eedc2b38-c9a4-4aa3-b63c-7402268d977c" released by "delete_volume" :: held 1.822s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:05 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] Created reservations ['f78039f6-aa8c-44e6-ac91-48a862366130', '72b44d77-6102-44a3-a642-2d474bcf8221', '40267893-273c-4f15-9cee-acd886b282e9', '109cdd72-2e1b-45f0-ad47-066d21bc5eb6'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:05 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:15:05 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:06 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.644s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:06 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:06 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] Deleted volume successfully. Sep 28 17:15:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6c171a1f-82e8-413a-a416-e9b1e2f622e7 tempest-VolumesSnapshotTestJSON-717735650 None] Lock "cinder-eedc2b38-c9a4-4aa3-b63c-7402268d977c-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:07 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e48af10c-0215-4e8a-b5be-10cc130f7135" returned: 0 in 9.562s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:07 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Image conversion details: src /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee, size 1024.00 MB, duration 9.56 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e48af10c-0215-4e8a-b5be-10cc130f7135 {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:15:07 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Converted 1024.00 MB image at 107.09 MB/s Sep 28 17:15:07 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e48af10c-0215-4e8a-b5be-10cc130f7135 is being set with open permissions: ugo+rw Sep 28 17:15:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e48af10c-0215-4e8a-b5be-10cc130f7135 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:07 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e48af10c-0215-4e8a-b5be-10cc130f7135 Sep 28 17:15:07 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:07 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e48af10c-0215-4e8a-b5be-10cc130f7135" returned: 0 in 0.361s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Lock "cinder-quobyte-e48af10c-0215-4e8a-b5be-10cc130f7135" released by "_copy_volume_from_snapshot" :: held 11.753s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Acquiring lock "cinder-quobyte-f66312e6-54db-4d2f-9eec-442d3b15f8a5" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Lock "cinder-quobyte-f66312e6-54db-4d2f-9eec-442d3b15f8a5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Deleting offline snapshot f66312e6-54db-4d2f-9eec-442d3b15f8a5 of volume 35e264af-0473-4472-8b3c-55a4e9694bee {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:15:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] snapshot_file for this snap is: volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:15:07 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e5fac8-a86d-4c6e-8759-2bb1ecdbbe4c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:07 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5 Sep 28 17:15:07 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:07 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5" returned: 0 in 0.483s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35e264af-0473-4472-8b3c-55a4e9694bee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:15:08 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b059ba1d-8d80-4945-aead-1f7c0fc8c321]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:08 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee Sep 28 17:15:08 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:08 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee" returned: 0 in 0.662s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:08 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5 Sep 28 17:15:08 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:09 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5" returned: 0 in 0.622s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:09 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5 Sep 28 17:15:09 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:09 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee.f66312e6-54db-4d2f-9eec-442d3b15f8a5" returned: 0 in 0.344s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Lock "cinder-quobyte-f66312e6-54db-4d2f-9eec-442d3b15f8a5" released by "_delete_snapshot" :: held 2.288s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.623s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.627s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407096807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8739f3a-11e8-4ecc-90ed-938a76a76f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5ce5ee9c3b4852ba4b41a8723bb60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:00Z,use_quota=True,user_id='7c202e120ff84b2eaef3c54c45e66e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Creating volume c8739f3a-11e8-4ecc-90ed-938a76a76f79 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:09 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034442f7-5d8e-4256-ab85-1ece5bf37c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e48af10c-0215-4e8a-b5be-10cc130f7135', 'volume_size': 2, 'source_volid': '35e264af-0473-4472-8b3c-55a4e9694bee', 'source_volstatus': 'available'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6841e793-46e8-49a3-8bd6-ff5f7b433ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:09 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79 1073741824 Sep 28 17:15:09 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:09 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Volume volume-e48af10c-0215-4e8a-b5be-10cc130f7135 (e48af10c-0215-4e8a-b5be-10cc130f7135): created successfully Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6841e793-46e8-49a3-8bd6-ff5f7b433ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Flow 'volume_create_manager' (42364d96-eb53-4a53-ad4e-928621f7879f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:09 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0aceba57-fef9-4875-a931-432b7acd09f9 tempest-VolumesCloneTest-1596688712 None] Created volume successfully. Sep 28 17:15:10 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79 1073741824" returned: 0 in 0.748s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:10 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79 Sep 28 17:15:10 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:11 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79" returned: 0 in 0.369s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7307096-fa54-48de-9105-09c2a3893e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87dd31f-484f-4449-9e48-ece3e0d8c7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:11 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79 (c8739f3a-11e8-4ecc-90ed-938a76a76f79): created successfully Sep 28 17:15:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87dd31f-484f-4449-9e48-ece3e0d8c7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Flow 'volume_create_manager' (18cca613-f853-49da-b5e4-b1e4fad01c49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:11 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-69b4c7f8-7312-4449-a2c1-24e258da1784 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Created volume successfully. Sep 28 17:15:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] Acquiring lock "cinder-e48af10c-0215-4e8a-b5be-10cc130f7135-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] Lock "cinder-e48af10c-0215-4e8a-b5be-10cc130f7135-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] Acquiring lock "cinder-quobyte-e48af10c-0215-4e8a-b5be-10cc130f7135" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] Lock "cinder-quobyte-e48af10c-0215-4e8a-b5be-10cc130f7135" acquired by "delete_volume" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:11 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7f425a-c6ac-4750-8e96-f89f6839d8d1]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e48af10c-0215-4e8a-b5be-10cc130f7135 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:11 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e48af10c-0215-4e8a-b5be-10cc130f7135 Sep 28 17:15:11 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:11 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e48af10c-0215-4e8a-b5be-10cc130f7135" returned: 0 in 0.550s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e48af10c-0215-4e8a-b5be-10cc130f7135 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:12 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e48af10c-0215-4e8a-b5be-10cc130f7135 Sep 28 17:15:12 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:12 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e48af10c-0215-4e8a-b5be-10cc130f7135" returned: 0 in 0.373s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:12 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] Lock "cinder-quobyte-e48af10c-0215-4e8a-b5be-10cc130f7135" released by "delete_volume" :: held 1.012s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:12 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] Created reservations ['ab7912b1-00fb-4dac-a417-72ee9f84076c', '9c7b08fb-bc03-413a-a124-d1ade55bfafd', '8e9bd717-76d1-4b26-af7b-c2bddf4dc0ec', 'a99e228a-17b5-4958-83e2-158e8b9e4f46'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:12 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:15:12 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:13 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Creating offline snapshot 677684ce-2e18-47ed-aeda-3efd016c7210 of volume c8739f3a-11e8-4ecc-90ed-938a76a76f79 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:15:13 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[c295d1d4-5f72-4d65-855a-dce1debafd4e]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:13 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.442s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:13 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:13 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] Deleted volume successfully. Sep 28 17:15:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cdddf1d0-6fba-4eb6-917b-dd7940315306 tempest-VolumesCloneTest-1596688712 None] Lock "cinder-e48af10c-0215-4e8a-b5be-10cc130f7135-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:13 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79 Sep 28 17:15:13 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:13 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79" returned: 0 in 0.660s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] Acquiring lock "cinder-35e264af-0473-4472-8b3c-55a4e9694bee-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:13 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210 1G Sep 28 17:15:13 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] Lock "cinder-35e264af-0473-4472-8b3c-55a4e9694bee-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] Acquiring lock "cinder-quobyte-35e264af-0473-4472-8b3c-55a4e9694bee" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] Lock "cinder-quobyte-35e264af-0473-4472-8b3c-55a4e9694bee" acquired by "delete_volume" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:14 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b8fc5b-4f6c-4cf3-a9f1-ce87896496af]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:14 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee Sep 28 17:15:14 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:14 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210 1G" returned: 0 in 0.654s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:14 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210 Sep 28 17:15:14 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:14 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee" returned: 0 in 0.551s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:14 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee Sep 28 17:15:14 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:14 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210" returned: 0 in 0.445s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:14 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210 is being set with open permissions: ugo+rw Sep 28 17:15:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:14 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210 Sep 28 17:15:14 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:15 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35e264af-0473-4472-8b3c-55a4e9694bee" returned: 0 in 0.455s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] Lock "cinder-quobyte-35e264af-0473-4472-8b3c-55a4e9694bee" released by "delete_volume" :: held 1.145s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] Created reservations ['634b07f1-6604-4ffc-a07c-450f096ec9e5', '97454f19-7afe-45ce-8485-83e722ac9865', '4bb48524-2503-4147-9acd-6017e0fc4e5d', '05ef7a07-5574-4020-a9b2-1ef88a7111a5'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:15 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210" returned: 0 in 0.362s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:15 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.info Sep 28 17:15:15 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:15 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:15:15 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:15 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.info" returned: 0 in 0.341s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:15 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.info is being set with open permissions: ugo+rw Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:15 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.info Sep 28 17:15:15 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:15 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.330s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:15 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] Deleted volume successfully. Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a6664730-c693-4676-bc49-e5d954db72af tempest-VolumesCloneTest-1596688712 None] Lock "cinder-35e264af-0473-4472-8b3c-55a4e9694bee-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:15 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.info" returned: 0 in 0.309s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.934s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:16 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2c689356-60b5-4dee-9ba0-12554e2be544 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Create snapshot completed successfully Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Flow 'volume_create_manager' (8c25f3b6-7b59-47de-8419-c7cc5d2e2395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49597b4-44fb-441f-96b1-153d540a4082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49597b4-44fb-441f-96b1-153d540a4082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-608392621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2da4372-cdfe-4f81-90ff-add51eb4f056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5ce5ee9c3b4852ba4b41a8723bb60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:17Z,use_quota=True,user_id='7c202e120ff84b2eaef3c54c45e66e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4468e85c-d144-4e2d-8afc-91daa86c93e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4468e85c-d144-4e2d-8afc-91daa86c93e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81645653-277c-44f1-9d91-3ac6a749abdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81645653-277c-44f1-9d91-3ac6a749abdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2da4372-cdfe-4f81-90ff-add51eb4f056', 'volume_name': 'volume-d2da4372-cdfe-4f81-90ff-add51eb4f056', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a92ba3-e92d-42af-beb7-c2a8a4d269fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a92ba3-e92d-42af-beb7-c2a8a4d269fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9eecdf0-a2e4-4037-91a2-91858ac8bbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:17 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume d2da4372-cdfe-4f81-90ff-add51eb4f056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2da4372-cdfe-4f81-90ff-add51eb4f056', 'volume_size': 1} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-608392621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2da4372-cdfe-4f81-90ff-add51eb4f056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5ce5ee9c3b4852ba4b41a8723bb60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:17Z,use_quota=True,user_id='7c202e120ff84b2eaef3c54c45e66e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Creating volume d2da4372-cdfe-4f81-90ff-add51eb4f056 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:17 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d2da4372-cdfe-4f81-90ff-add51eb4f056 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:17 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d2da4372-cdfe-4f81-90ff-add51eb4f056 1073741824 Sep 28 17:15:17 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Flow 'volume_create_manager' (8ee55934-6cac-4300-b4b5-101b5ac13f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d2a0b4-964c-4901-a89d-1bf79ce6a0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d2a0b4-964c-4901-a89d-1bf79ce6a0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1122016655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f5ec2f-485f-4a5a-8381-2552d941e56a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5ce5ee9c3b4852ba4b41a8723bb60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:18Z,use_quota=True,user_id='7c202e120ff84b2eaef3c54c45e66e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d6924c-5c51-44e1-a345-f1cc2a56bcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d6924c-5c51-44e1-a345-f1cc2a56bcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64550b5-5ffb-4527-984a-4c3626befc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64550b5-5ffb-4527-984a-4c3626befc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f5ec2f-485f-4a5a-8381-2552d941e56a', 'volume_name': 'volume-f0f5ec2f-485f-4a5a-8381-2552d941e56a', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebcea65-694a-47e2-a6d0-eb0c928d3520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebcea65-694a-47e2-a6d0-eb0c928d3520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f541f79d-6dae-45c9-8ed5-bf3d335a9fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:18 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume f0f5ec2f-485f-4a5a-8381-2552d941e56a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f5ec2f-485f-4a5a-8381-2552d941e56a', 'volume_size': 1} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:18 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d2da4372-cdfe-4f81-90ff-add51eb4f056 1073741824" returned: 0 in 0.782s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d2da4372-cdfe-4f81-90ff-add51eb4f056 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:18 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d2da4372-cdfe-4f81-90ff-add51eb4f056 Sep 28 17:15:18 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:18 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d2da4372-cdfe-4f81-90ff-add51eb4f056" returned: 0 in 0.348s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1122016655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f5ec2f-485f-4a5a-8381-2552d941e56a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5ce5ee9c3b4852ba4b41a8723bb60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:18Z,use_quota=True,user_id='7c202e120ff84b2eaef3c54c45e66e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Creating volume f0f5ec2f-485f-4a5a-8381-2552d941e56a {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:18 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f0f5ec2f-485f-4a5a-8381-2552d941e56a 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:18 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f0f5ec2f-485f-4a5a-8381-2552d941e56a 1073741824 Sep 28 17:15:18 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Flow 'volume_create_manager' (96426560-3e62-4082-bb3b-a5e0a336e3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84028f1-8ced-45ef-b813-45c1dfb4f585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84028f1-8ced-45ef-b813-45c1dfb4f585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-32919656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a464713a-652e-44a4-a6c0-bc750d201f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5ce5ee9c3b4852ba4b41a8723bb60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:18Z,use_quota=True,user_id='7c202e120ff84b2eaef3c54c45e66e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fea6f2-80a3-43b0-9e11-0a7286d55820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fea6f2-80a3-43b0-9e11-0a7286d55820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe1114a-830e-40a1-ad05-cfad3c92058a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe1114a-830e-40a1-ad05-cfad3c92058a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a464713a-652e-44a4-a6c0-bc750d201f70', 'volume_name': 'volume-a464713a-652e-44a4-a6c0-bc750d201f70', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85a3e6b-6637-4ee3-8294-7f6ce2ae8cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85a3e6b-6637-4ee3-8294-7f6ce2ae8cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862d0825-3e66-4c88-aa91-6289ff13c108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:18 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume a464713a-652e-44a4-a6c0-bc750d201f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a464713a-652e-44a4-a6c0-bc750d201f70', 'volume_size': 1} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9eecdf0-a2e4-4037-91a2-91858ac8bbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2da4372-cdfe-4f81-90ff-add51eb4f056', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f09ba9-c87b-4437-8c03-62c38db9ece9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:19 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume volume-d2da4372-cdfe-4f81-90ff-add51eb4f056 (d2da4372-cdfe-4f81-90ff-add51eb4f056): created successfully Sep 28 17:15:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f09ba9-c87b-4437-8c03-62c38db9ece9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Flow 'volume_create_manager' (8c25f3b6-7b59-47de-8419-c7cc5d2e2395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:19 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1b9a6ade-7ce4-49a0-877f-2dcf99ee7fb3 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Created volume successfully. Sep 28 17:15:19 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f0f5ec2f-485f-4a5a-8381-2552d941e56a 1073741824" returned: 0 in 0.944s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:19 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Flow 'volume_create_manager' (8bc9c870-23a1-4299-9038-3f230753549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78ba13e-8d60-4445-89c1-c0b426606a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78ba13e-8d60-4445-89c1-c0b426606a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148332919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d72cad-2157-4bb8-99a6-06b54e2de3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5ce5ee9c3b4852ba4b41a8723bb60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:19Z,use_quota=True,user_id='7c202e120ff84b2eaef3c54c45e66e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb7ea35-cbf9-4164-8f36-c14178433cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb7ea35-cbf9-4164-8f36-c14178433cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b427a9d7-3f67-4037-b820-be98a097fcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b427a9d7-3f67-4037-b820-be98a097fcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d72cad-2157-4bb8-99a6-06b54e2de3a2', 'volume_name': 'volume-81d72cad-2157-4bb8-99a6-06b54e2de3a2', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3154be1-9703-45e6-a74c-6bcb003f274b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3154be1-9703-45e6-a74c-6bcb003f274b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fd85a5-41ae-4815-8687-16f621b721a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:19 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume 81d72cad-2157-4bb8-99a6-06b54e2de3a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d72cad-2157-4bb8-99a6-06b54e2de3a2', 'volume_size': 1} Sep 28 17:15:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f0f5ec2f-485f-4a5a-8381-2552d941e56a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:19 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f0f5ec2f-485f-4a5a-8381-2552d941e56a Sep 28 17:15:19 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:20 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f0f5ec2f-485f-4a5a-8381-2552d941e56a" returned: 0 in 0.500s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.293s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-32919656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a464713a-652e-44a4-a6c0-bc750d201f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5ce5ee9c3b4852ba4b41a8723bb60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:18Z,use_quota=True,user_id='7c202e120ff84b2eaef3c54c45e66e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Creating volume a464713a-652e-44a4-a6c0-bc750d201f70 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:20 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a464713a-652e-44a4-a6c0-bc750d201f70 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f541f79d-6dae-45c9-8ed5-bf3d335a9fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f5ec2f-485f-4a5a-8381-2552d941e56a', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:20 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a464713a-652e-44a4-a6c0-bc750d201f70 1073741824 Sep 28 17:15:20 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae7b9fc-e6e0-4919-8cf0-af917ef0e0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:20 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume volume-f0f5ec2f-485f-4a5a-8381-2552d941e56a (f0f5ec2f-485f-4a5a-8381-2552d941e56a): created successfully Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae7b9fc-e6e0-4919-8cf0-af917ef0e0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Flow 'volume_create_manager' (8ee55934-6cac-4300-b4b5-101b5ac13f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:20 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-c9e4354f-341e-446f-8c80-862afafec57a tempest-CreateVolumesFromSnapshotTest-2130330566 None] Created volume successfully. Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Flow 'volume_create_manager' (e4496b7f-80e1-44c1-8de9-0bda1030002c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8710f6-3042-4a4e-b93d-77a3a6e79b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8710f6-3042-4a4e-b93d-77a3a6e79b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754606260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1befc1b9-7f5e-4d8c-be15-7a95666f6eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5ce5ee9c3b4852ba4b41a8723bb60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:20Z,use_quota=True,user_id='7c202e120ff84b2eaef3c54c45e66e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2a6d17-faf4-49f6-9498-9ef2636826ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2a6d17-faf4-49f6-9498-9ef2636826ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a6859c-4327-4871-b0d0-30ebfa1d1a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a6859c-4327-4871-b0d0-30ebfa1d1a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1befc1b9-7f5e-4d8c-be15-7a95666f6eef', 'volume_name': 'volume-1befc1b9-7f5e-4d8c-be15-7a95666f6eef', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cd048e-aab0-4f9a-b6c7-14d9c6bde8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cd048e-aab0-4f9a-b6c7-14d9c6bde8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071eb788-b2dd-42cd-bda3-77d903088cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:20 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume 1befc1b9-7f5e-4d8c-be15-7a95666f6eef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1befc1b9-7f5e-4d8c-be15-7a95666f6eef', 'volume_size': 1} Sep 28 17:15:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:21 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a464713a-652e-44a4-a6c0-bc750d201f70 1073741824" returned: 0 in 0.856s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a464713a-652e-44a4-a6c0-bc750d201f70 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:21 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a464713a-652e-44a4-a6c0-bc750d201f70 Sep 28 17:15:21 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:21 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a464713a-652e-44a4-a6c0-bc750d201f70" returned: 0 in 0.326s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.828s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148332919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d72cad-2157-4bb8-99a6-06b54e2de3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5ce5ee9c3b4852ba4b41a8723bb60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:19Z,use_quota=True,user_id='7c202e120ff84b2eaef3c54c45e66e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Creating volume 81d72cad-2157-4bb8-99a6-06b54e2de3a2 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:21 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-81d72cad-2157-4bb8-99a6-06b54e2de3a2 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:21 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-81d72cad-2157-4bb8-99a6-06b54e2de3a2 1073741824 Sep 28 17:15:21 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862d0825-3e66-4c88-aa91-6289ff13c108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a464713a-652e-44a4-a6c0-bc750d201f70', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35aa6d86-1a93-40ef-ae71-280e9423bd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:21 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume volume-a464713a-652e-44a4-a6c0-bc750d201f70 (a464713a-652e-44a4-a6c0-bc750d201f70): created successfully Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35aa6d86-1a93-40ef-ae71-280e9423bd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Flow 'volume_create_manager' (96426560-3e62-4082-bb3b-a5e0a336e3e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:21 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-04a7357f-49c0-443a-b1a9-8592308c9426 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Created volume successfully. Sep 28 17:15:22 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-81d72cad-2157-4bb8-99a6-06b54e2de3a2 1073741824" returned: 0 in 0.874s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-81d72cad-2157-4bb8-99a6-06b54e2de3a2 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:22 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-81d72cad-2157-4bb8-99a6-06b54e2de3a2 Sep 28 17:15:22 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:22 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-81d72cad-2157-4bb8-99a6-06b54e2de3a2" returned: 0 in 0.488s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.330s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754606260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1befc1b9-7f5e-4d8c-be15-7a95666f6eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5ce5ee9c3b4852ba4b41a8723bb60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:20Z,use_quota=True,user_id='7c202e120ff84b2eaef3c54c45e66e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Creating volume 1befc1b9-7f5e-4d8c-be15-7a95666f6eef {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:22 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:15:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1befc1b9-7f5e-4d8c-be15-7a95666f6eef 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:23 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1befc1b9-7f5e-4d8c-be15-7a95666f6eef 1073741824 Sep 28 17:15:23 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fd85a5-41ae-4815-8687-16f621b721a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d72cad-2157-4bb8-99a6-06b54e2de3a2', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a350bce-39af-4e2d-adc2-b8dc258f8182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:23 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume volume-81d72cad-2157-4bb8-99a6-06b54e2de3a2 (81d72cad-2157-4bb8-99a6-06b54e2de3a2): created successfully Sep 28 17:15:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a350bce-39af-4e2d-adc2-b8dc258f8182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Flow 'volume_create_manager' (8bc9c870-23a1-4299-9038-3f230753549f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:23 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-7008dfa5-e0fb-480a-bfd5-227dbb0b6905 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Created volume successfully. Sep 28 17:15:23 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1befc1b9-7f5e-4d8c-be15-7a95666f6eef 1073741824" returned: 0 in 0.806s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1befc1b9-7f5e-4d8c-be15-7a95666f6eef {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:23 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1befc1b9-7f5e-4d8c-be15-7a95666f6eef Sep 28 17:15:23 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:24 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1befc1b9-7f5e-4d8c-be15-7a95666f6eef" returned: 0 in 0.521s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071eb788-b2dd-42cd-bda3-77d903088cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1befc1b9-7f5e-4d8c-be15-7a95666f6eef', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8d00c9-c74e-43e9-b576-85a2d724121e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:24 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Volume volume-1befc1b9-7f5e-4d8c-be15-7a95666f6eef (1befc1b9-7f5e-4d8c-be15-7a95666f6eef): created successfully Sep 28 17:15:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8d00c9-c74e-43e9-b576-85a2d724121e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Flow 'volume_create_manager' (e4496b7f-80e1-44c1-8de9-0bda1030002c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:24 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2d1be49a-44f9-40a5-9a04-8ecdb10fd962 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Created volume successfully. Sep 28 17:15:25 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "cinder-1befc1b9-7f5e-4d8c-be15-7a95666f6eef-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:25 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-1befc1b9-7f5e-4d8c-be15-7a95666f6eef-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:25 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "cinder-quobyte-1befc1b9-7f5e-4d8c-be15-7a95666f6eef" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:25 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-quobyte-1befc1b9-7f5e-4d8c-be15-7a95666f6eef" acquired by "delete_volume" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:25 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7a2956-2e06-4b69-bd93-ed78d6ff3ad7]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1befc1b9-7f5e-4d8c-be15-7a95666f6eef {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:25 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1befc1b9-7f5e-4d8c-be15-7a95666f6eef Sep 28 17:15:25 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:26 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Flow 'volume_create_manager' (ee8abec4-e0fe-4ba1-b6a6-e7a93c7bcdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10be5f9c-8762-421a-bac1-13808b4ac806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1befc1b9-7f5e-4d8c-be15-7a95666f6eef" returned: 0 in 0.720s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1befc1b9-7f5e-4d8c-be15-7a95666f6eef {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10be5f9c-8762-421a-bac1-13808b4ac806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1846157099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5107f26-f741-41c2-961f-5b9a145583fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='20c739fe468d4050bb847afa2fc57453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:26Z,use_quota=True,user_id='2b1a8e69667946ac931bab0062ec761c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:26 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1befc1b9-7f5e-4d8c-be15-7a95666f6eef Sep 28 17:15:26 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb915f5-0614-4649-9a29-4b126efd1d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb915f5-0614-4649-9a29-4b126efd1d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298235a2-1467-41ff-9a80-4696054fb6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298235a2-1467-41ff-9a80-4696054fb6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5107f26-f741-41c2-961f-5b9a145583fc', 'volume_name': 'volume-e5107f26-f741-41c2-961f-5b9a145583fc', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cec2b2-b31e-4046-8f5e-aa4a219a09d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cec2b2-b31e-4046-8f5e-aa4a219a09d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b8cc3d-2da4-433f-864e-e2caacdb74fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:26 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Volume e5107f26-f741-41c2-961f-5b9a145583fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5107f26-f741-41c2-961f-5b9a145583fc', 'volume_size': 1} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1846157099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5107f26-f741-41c2-961f-5b9a145583fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='20c739fe468d4050bb847afa2fc57453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:26Z,use_quota=True,user_id='2b1a8e69667946ac931bab0062ec761c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Creating volume e5107f26-f741-41c2-961f-5b9a145583fc {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:26 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e5107f26-f741-41c2-961f-5b9a145583fc 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:26 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e5107f26-f741-41c2-961f-5b9a145583fc 1073741824 Sep 28 17:15:26 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:26 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1befc1b9-7f5e-4d8c-be15-7a95666f6eef" returned: 0 in 0.460s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-quobyte-1befc1b9-7f5e-4d8c-be15-7a95666f6eef" released by "delete_volume" :: held 1.264s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:26 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Created reservations ['4d61bdb4-6fce-43b2-b8a8-5ee846c99a99', 'dd33ba41-e8f2-417e-9eee-c45bc74e1c6e', 'be069d65-1c8a-4d88-93b8-b2aaf40223d5', 'd629d40a-4cb0-41b5-9b36-871b8e6e9ebb'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:27 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:15:27 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:27 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e5107f26-f741-41c2-961f-5b9a145583fc 1073741824" returned: 0 in 0.823s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e5107f26-f741-41c2-961f-5b9a145583fc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:27 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e5107f26-f741-41c2-961f-5b9a145583fc Sep 28 17:15:27 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:27 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.445s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:27 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Deleted volume successfully. Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-12efc01e-6311-42cc-9839-046cc067cbc9 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-1befc1b9-7f5e-4d8c-be15-7a95666f6eef-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:27 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e5107f26-f741-41c2-961f-5b9a145583fc" returned: 0 in 0.403s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b8cc3d-2da4-433f-864e-e2caacdb74fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5107f26-f741-41c2-961f-5b9a145583fc', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d760a83-c335-4e69-901e-9f6f9658d827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "cinder-81d72cad-2157-4bb8-99a6-06b54e2de3a2-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:27 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Volume volume-e5107f26-f741-41c2-961f-5b9a145583fc (e5107f26-f741-41c2-961f-5b9a145583fc): created successfully Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d760a83-c335-4e69-901e-9f6f9658d827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Flow 'volume_create_manager' (ee8abec4-e0fe-4ba1-b6a6-e7a93c7bcdc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-81d72cad-2157-4bb8-99a6-06b54e2de3a2-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:27 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-bd288e24-ce35-48c5-bb9e-06afce44c0af tempest-VolumesListTestJSON-1943127706 None] Created volume successfully. Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "cinder-quobyte-81d72cad-2157-4bb8-99a6-06b54e2de3a2" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-quobyte-81d72cad-2157-4bb8-99a6-06b54e2de3a2" acquired by "delete_volume" :: waited 0.015s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12e4e5c-4e33-4f8a-96da-592879843858]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-81d72cad-2157-4bb8-99a6-06b54e2de3a2 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:28 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-81d72cad-2157-4bb8-99a6-06b54e2de3a2 Sep 28 17:15:28 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:28 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-81d72cad-2157-4bb8-99a6-06b54e2de3a2" returned: 0 in 0.720s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-81d72cad-2157-4bb8-99a6-06b54e2de3a2 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:28 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-81d72cad-2157-4bb8-99a6-06b54e2de3a2 Sep 28 17:15:28 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:29 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-81d72cad-2157-4bb8-99a6-06b54e2de3a2" returned: 0 in 0.416s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-quobyte-81d72cad-2157-4bb8-99a6-06b54e2de3a2" released by "delete_volume" :: held 1.202s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Created reservations ['dd59daaa-f5a0-46e8-9c84-1dea69118f3e', '17b1fd16-11b2-41d2-8c1b-4fc71bd80b66', '41048daf-1824-4ba7-9aae-87ed3c103ae2', '4b16ded0-e63e-4e5b-a6cb-cf55a4ef78c0'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Flow 'volume_create_manager' (99604a8d-e619-45ed-8264-1e8ca45ca1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055275e3-4913-4e45-9ac7-2273b23b1e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055275e3-4913-4e45-9ac7-2273b23b1e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-360088948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01a6d8c-3ce1-4ce3-af11-2b044afad517,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='20c739fe468d4050bb847afa2fc57453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:29Z,use_quota=True,user_id='2b1a8e69667946ac931bab0062ec761c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb09d678-c41c-4d73-b367-93c3ae49b428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb09d678-c41c-4d73-b367-93c3ae49b428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abfe72e-062b-40fb-a5b9-675c4eb1f78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abfe72e-062b-40fb-a5b9-675c4eb1f78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b01a6d8c-3ce1-4ce3-af11-2b044afad517', 'volume_name': 'volume-b01a6d8c-3ce1-4ce3-af11-2b044afad517', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4b9d24-74fe-4d6a-b553-ae429ec79e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4b9d24-74fe-4d6a-b553-ae429ec79e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f1d92e-869c-4524-9ae5-00ac84024ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:29 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Volume b01a6d8c-3ce1-4ce3-af11-2b044afad517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b01a6d8c-3ce1-4ce3-af11-2b044afad517', 'volume_size': 1} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-360088948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01a6d8c-3ce1-4ce3-af11-2b044afad517,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='20c739fe468d4050bb847afa2fc57453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:29Z,use_quota=True,user_id='2b1a8e69667946ac931bab0062ec761c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Creating volume b01a6d8c-3ce1-4ce3-af11-2b044afad517 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:29 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b01a6d8c-3ce1-4ce3-af11-2b044afad517 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:29 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b01a6d8c-3ce1-4ce3-af11-2b044afad517 1073741824 Sep 28 17:15:29 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:29 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:15:29 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:29 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.398s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:29 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Deleted volume successfully. Sep 28 17:15:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33e14f67-4ef7-4ab4-93af-c03e38e54718 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-81d72cad-2157-4bb8-99a6-06b54e2de3a2-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:30 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b01a6d8c-3ce1-4ce3-af11-2b044afad517 1073741824" returned: 0 in 0.685s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b01a6d8c-3ce1-4ce3-af11-2b044afad517 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:30 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b01a6d8c-3ce1-4ce3-af11-2b044afad517 Sep 28 17:15:30 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "cinder-a464713a-652e-44a4-a6c0-bc750d201f70-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-a464713a-652e-44a4-a6c0-bc750d201f70-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "cinder-quobyte-a464713a-652e-44a4-a6c0-bc750d201f70" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-quobyte-a464713a-652e-44a4-a6c0-bc750d201f70" acquired by "delete_volume" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:30 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c661e74-8abd-418c-b07d-beed1adcbf30]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a464713a-652e-44a4-a6c0-bc750d201f70 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:30 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:30 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a464713a-652e-44a4-a6c0-bc750d201f70 Sep 28 17:15:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b01a6d8c-3ce1-4ce3-af11-2b044afad517" returned: 0 in 0.459s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:30 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f1d92e-869c-4524-9ae5-00ac84024ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b01a6d8c-3ce1-4ce3-af11-2b044afad517', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2513075a-67e7-4b74-8938-e2a0cd999d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:30 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Volume volume-b01a6d8c-3ce1-4ce3-af11-2b044afad517 (b01a6d8c-3ce1-4ce3-af11-2b044afad517): created successfully Sep 28 17:15:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2513075a-67e7-4b74-8938-e2a0cd999d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Flow 'volume_create_manager' (99604a8d-e619-45ed-8264-1e8ca45ca1e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:30 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-f94c529f-297b-4b33-9c26-f69ae9a2a961 tempest-VolumesListTestJSON-1943127706 None] Created volume successfully. Sep 28 17:15:30 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a464713a-652e-44a4-a6c0-bc750d201f70" returned: 0 in 0.498s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a464713a-652e-44a4-a6c0-bc750d201f70 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:30 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a464713a-652e-44a4-a6c0-bc750d201f70 Sep 28 17:15:30 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:31 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a464713a-652e-44a4-a6c0-bc750d201f70" returned: 0 in 0.307s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-quobyte-a464713a-652e-44a4-a6c0-bc750d201f70" released by "delete_volume" :: held 0.888s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:31 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Created reservations ['de95e916-2a4c-4f30-b692-62cd7fd5c476', '82e087aa-2f24-4fda-8e4a-be6d4fb71cdd', '0255e51a-01d6-4e51-bd30-e15f3b22c817', '5c6923a5-5aca-4b04-82c2-22aa39eafa31'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:31 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:15:31 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "cinder-f0f5ec2f-485f-4a5a-8381-2552d941e56a-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-f0f5ec2f-485f-4a5a-8381-2552d941e56a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "cinder-quobyte-f0f5ec2f-485f-4a5a-8381-2552d941e56a" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-quobyte-f0f5ec2f-485f-4a5a-8381-2552d941e56a" acquired by "delete_volume" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:31 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[6260a2c4-ca57-4471-af9c-77c61b723834]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f0f5ec2f-485f-4a5a-8381-2552d941e56a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:32 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f0f5ec2f-485f-4a5a-8381-2552d941e56a Sep 28 17:15:32 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:32 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.821s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:32 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Deleted volume successfully. Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5a4b7b0d-43e4-4e7c-8c01-401610a72274 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-a464713a-652e-44a4-a6c0-bc750d201f70-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Flow 'volume_create_manager' (b624e130-9bfa-419f-b4c1-0b72a3658837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078ad923-948c-47a9-b61d-666d14f8223c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078ad923-948c-47a9-b61d-666d14f8223c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-775819736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42aa19eb-f3fc-42f9-b7de-12b407ed25bf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='20c739fe468d4050bb847afa2fc57453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:32Z,use_quota=True,user_id='2b1a8e69667946ac931bab0062ec761c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1707a485-a913-426b-aac9-51fccdadb4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1707a485-a913-426b-aac9-51fccdadb4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b529371-de04-4f95-9702-ed591800f6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b529371-de04-4f95-9702-ed591800f6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42aa19eb-f3fc-42f9-b7de-12b407ed25bf', 'volume_name': 'volume-42aa19eb-f3fc-42f9-b7de-12b407ed25bf', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36db40f4-b43d-4998-acc6-4572d5551a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:32 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36db40f4-b43d-4998-acc6-4572d5551a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5045162-4dca-4d59-b2a6-c0c584534a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:32 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Volume 42aa19eb-f3fc-42f9-b7de-12b407ed25bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42aa19eb-f3fc-42f9-b7de-12b407ed25bf', 'volume_size': 1} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-775819736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42aa19eb-f3fc-42f9-b7de-12b407ed25bf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='20c739fe468d4050bb847afa2fc57453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:32Z,use_quota=True,user_id='2b1a8e69667946ac931bab0062ec761c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Creating volume 42aa19eb-f3fc-42f9-b7de-12b407ed25bf {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:32 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-42aa19eb-f3fc-42f9-b7de-12b407ed25bf 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f0f5ec2f-485f-4a5a-8381-2552d941e56a" returned: 0 in 0.886s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f0f5ec2f-485f-4a5a-8381-2552d941e56a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:32 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-42aa19eb-f3fc-42f9-b7de-12b407ed25bf 1073741824 Sep 28 17:15:32 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:32 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f0f5ec2f-485f-4a5a-8381-2552d941e56a Sep 28 17:15:32 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:33 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f0f5ec2f-485f-4a5a-8381-2552d941e56a" returned: 0 in 0.452s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-quobyte-f0f5ec2f-485f-4a5a-8381-2552d941e56a" released by "delete_volume" :: held 1.484s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:33 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Created reservations ['02c6c221-d32a-4ae6-993a-e039949d9ca7', 'dd4d91dc-b06a-4d3e-95ed-e7047d16e5a2', '418d8c77-edfa-49f2-8d83-6550fddc1443', '986de0c0-dd40-4fe1-bc44-d7810aae82ee'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:33 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-42aa19eb-f3fc-42f9-b7de-12b407ed25bf 1073741824" returned: 0 in 0.770s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-42aa19eb-f3fc-42f9-b7de-12b407ed25bf {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:33 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:15:33 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:33 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-42aa19eb-f3fc-42f9-b7de-12b407ed25bf Sep 28 17:15:33 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:33 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-42aa19eb-f3fc-42f9-b7de-12b407ed25bf" returned: 0 in 0.379s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5045162-4dca-4d59-b2a6-c0c584534a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42aa19eb-f3fc-42f9-b7de-12b407ed25bf', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76ecee2-add0-4993-bf55-966be9b82718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "cinder-d2da4372-cdfe-4f81-90ff-add51eb4f056-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:34 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Volume volume-42aa19eb-f3fc-42f9-b7de-12b407ed25bf (42aa19eb-f3fc-42f9-b7de-12b407ed25bf): created successfully Sep 28 17:15:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76ecee2-add0-4993-bf55-966be9b82718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Flow 'volume_create_manager' (b624e130-9bfa-419f-b4c1-0b72a3658837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:34 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-d2da4372-cdfe-4f81-90ff-add51eb4f056-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.596s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:34 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:34 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Deleted volume successfully. Sep 28 17:15:34 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-cc589ef9-ed19-4048-99ff-35513c0f81f5 tempest-VolumesListTestJSON-1943127706 None] Created volume successfully. Sep 28 17:15:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-13c60795-db32-4564-979c-61cea5b30262 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-f0f5ec2f-485f-4a5a-8381-2552d941e56a-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "cinder-quobyte-d2da4372-cdfe-4f81-90ff-add51eb4f056" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-quobyte-d2da4372-cdfe-4f81-90ff-add51eb4f056" acquired by "delete_volume" :: waited 0.037s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:34 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb23f2d-be0c-4b3e-8090-26e9b75d24de]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d2da4372-cdfe-4f81-90ff-add51eb4f056 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:34 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d2da4372-cdfe-4f81-90ff-add51eb4f056 Sep 28 17:15:34 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:35 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d2da4372-cdfe-4f81-90ff-add51eb4f056" returned: 0 in 0.840s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d2da4372-cdfe-4f81-90ff-add51eb4f056 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:35 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d2da4372-cdfe-4f81-90ff-add51eb4f056 Sep 28 17:15:35 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:35 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d2da4372-cdfe-4f81-90ff-add51eb4f056" returned: 0 in 0.488s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-quobyte-d2da4372-cdfe-4f81-90ff-add51eb4f056" released by "delete_volume" :: held 1.439s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:35 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Created reservations ['f5e16db6-fdc3-4a94-aef5-5eeef425053c', 'ed78c397-fc23-4646-a7b9-b0a66ccb4660', 'ce75f010-66f1-46f4-8507-3361243848cc', '6b597d15-a70a-4e47-99a8-538f6fa51238'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:36 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:15:36 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:36 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.512s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "cinder-677684ce-2e18-47ed-aeda-3efd016c7210-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:36 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:36 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Deleted volume successfully. Sep 28 17:15:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-677684ce-2e18-47ed-aeda-3efd016c7210-delete_snapshot" acquired by "delete_snapshot" :: waited 0.086s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "cinder-quobyte-c8739f3a-11e8-4ecc-90ed-938a76a76f79" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b19a2efc-4ad0-4c50-8a14-85ba2b05fef8 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-d2da4372-cdfe-4f81-90ff-add51eb4f056-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-quobyte-c8739f3a-11e8-4ecc-90ed-938a76a76f79" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "cinder-quobyte-677684ce-2e18-47ed-aeda-3efd016c7210" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-quobyte-677684ce-2e18-47ed-aeda-3efd016c7210" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Deleting offline snapshot 677684ce-2e18-47ed-aeda-3efd016c7210 of volume c8739f3a-11e8-4ecc-90ed-938a76a76f79 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:15:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] snapshot_file for this snap is: volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:15:36 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3786be5e-461c-4991-834f-ed25d5ca4cc1]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:36 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210 Sep 28 17:15:36 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:37 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210" returned: 0 in 0.572s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:15:37 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e113499-7ef7-48ed-9289-141cb66fc3e2]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:37 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79 Sep 28 17:15:37 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:38 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79" returned: 0 in 0.693s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:38 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210 Sep 28 17:15:38 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] Acquiring lock "cinder-42aa19eb-f3fc-42f9-b7de-12b407ed25bf-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] Lock "cinder-42aa19eb-f3fc-42f9-b7de-12b407ed25bf-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] Acquiring lock "cinder-quobyte-42aa19eb-f3fc-42f9-b7de-12b407ed25bf" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] Lock "cinder-quobyte-42aa19eb-f3fc-42f9-b7de-12b407ed25bf" acquired by "delete_volume" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:38 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ddcb43-01f0-442e-80b8-5d281823a2c1]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-42aa19eb-f3fc-42f9-b7de-12b407ed25bf {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:38 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210" returned: 0 in 0.573s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:38 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210 Sep 28 17:15:38 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:38 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-42aa19eb-f3fc-42f9-b7de-12b407ed25bf Sep 28 17:15:38 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:39 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79.677684ce-2e18-47ed-aeda-3efd016c7210" returned: 0 in 0.379s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:39 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-42aa19eb-f3fc-42f9-b7de-12b407ed25bf" returned: 0 in 0.539s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-42aa19eb-f3fc-42f9-b7de-12b407ed25bf {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-quobyte-677684ce-2e18-47ed-aeda-3efd016c7210" released by "_delete_snapshot" :: held 2.456s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:39 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-42aa19eb-f3fc-42f9-b7de-12b407ed25bf Sep 28 17:15:39 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-quobyte-c8739f3a-11e8-4ecc-90ed-938a76a76f79" released by "delete_snapshot" :: held 2.530s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Created reservations ['dd46f9c2-874e-431e-80f8-0e432617084a', 'fd308e41-001e-4224-880e-4555cdba263d', 'bd77cf98-438b-4722-81f7-e7f418da3d0c', '463181ce-a809-4d11-9119-2bc3425cf205'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:39 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Delete snapshot completed successfully. Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-42b9155a-be00-4bee-812a-4d8d5931b6f2 tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-677684ce-2e18-47ed-aeda-3efd016c7210-delete_snapshot" released by "delete_snapshot" :: held 2.880s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:39 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-42aa19eb-f3fc-42f9-b7de-12b407ed25bf" returned: 0 in 0.420s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] Lock "cinder-quobyte-42aa19eb-f3fc-42f9-b7de-12b407ed25bf" released by "delete_volume" :: held 1.048s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] Created reservations ['acce6ec8-3823-44cd-961d-ea92acb4339e', '0f56189f-b471-4598-bc3b-6106bdd8257a', '56666b22-c55d-4d8d-97ce-dc251ed9b19b', 'ce94e868-0ee7-4ae6-af3c-9737ac2df9e9'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "cinder-c8739f3a-11e8-4ecc-90ed-938a76a76f79-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-c8739f3a-11e8-4ecc-90ed-938a76a76f79-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:39 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:15:39 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "cinder-quobyte-c8739f3a-11e8-4ecc-90ed-938a76a76f79" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-quobyte-c8739f3a-11e8-4ecc-90ed-938a76a76f79" acquired by "delete_volume" :: waited 0.024s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:40 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09d0b37-5519-44b7-8b58-cfa29bd416cc]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:40 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79 Sep 28 17:15:40 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:40 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.502s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:40 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:40 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] Deleted volume successfully. Sep 28 17:15:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a832d5e2-f614-4de5-a565-850331417628 tempest-VolumesListTestJSON-1943127706 None] Lock "cinder-42aa19eb-f3fc-42f9-b7de-12b407ed25bf-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:40 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79" returned: 0 in 0.604s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:40 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79 Sep 28 17:15:40 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] Acquiring lock "cinder-b01a6d8c-3ce1-4ce3-af11-2b044afad517-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] Lock "cinder-b01a6d8c-3ce1-4ce3-af11-2b044afad517-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] Acquiring lock "cinder-quobyte-b01a6d8c-3ce1-4ce3-af11-2b044afad517" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] Lock "cinder-quobyte-b01a6d8c-3ce1-4ce3-af11-2b044afad517" acquired by "delete_volume" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:41 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f39cc9-cce4-486b-9d05-278c41636653]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b01a6d8c-3ce1-4ce3-af11-2b044afad517 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:41 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c8739f3a-11e8-4ecc-90ed-938a76a76f79" returned: 0 in 0.519s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-quobyte-c8739f3a-11e8-4ecc-90ed-938a76a76f79" released by "delete_volume" :: held 1.224s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:41 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b01a6d8c-3ce1-4ce3-af11-2b044afad517 Sep 28 17:15:41 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:41 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] Created reservations ['2bb6da45-1fc6-43d8-ac39-44ad9e67f43e', '3224a7be-b79c-4017-88c6-4f3d63aee5fd', 'b009b627-4611-4931-9c6a-4c322197267d', '0c9b151f-e6b4-46d6-b818-faf43a780578'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:41 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:15:41 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:41 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b01a6d8c-3ce1-4ce3-af11-2b044afad517" returned: 0 in 0.738s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b01a6d8c-3ce1-4ce3-af11-2b044afad517 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:41 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b01a6d8c-3ce1-4ce3-af11-2b044afad517 Sep 28 17:15:41 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:42 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.655s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:42 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:42 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] Deleted volume successfully. Sep 28 17:15:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a1c3da42-79c7-4f79-aba2-e6f2e7dfff4d tempest-CreateVolumesFromSnapshotTest-2130330566 None] Lock "cinder-c8739f3a-11e8-4ecc-90ed-938a76a76f79-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:42 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b01a6d8c-3ce1-4ce3-af11-2b044afad517" returned: 0 in 0.622s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] Lock "cinder-quobyte-b01a6d8c-3ce1-4ce3-af11-2b044afad517" released by "delete_volume" :: held 1.458s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:42 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] Created reservations ['8d3b9851-f86d-4e59-971b-b6c0539c3550', '901c538d-a742-496d-a066-ad8afddd71df', 'e8e0f108-f67b-4f14-bc0e-4c835967893c', '34572e4c-bb7c-4fec-92f5-f627a8e4bf35'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:42 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:15:42 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:43 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.552s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:43 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:43 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] Deleted volume successfully. Sep 28 17:15:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-7df08d82-a4c0-4b5a-8ce1-cc98d7ce6aa1 tempest-VolumesListTestJSON-1943127706 None] Lock "cinder-b01a6d8c-3ce1-4ce3-af11-2b044afad517-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] Acquiring lock "cinder-e5107f26-f741-41c2-961f-5b9a145583fc-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] Lock "cinder-e5107f26-f741-41c2-961f-5b9a145583fc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] Acquiring lock "cinder-quobyte-e5107f26-f741-41c2-961f-5b9a145583fc" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] Lock "cinder-quobyte-e5107f26-f741-41c2-961f-5b9a145583fc" acquired by "delete_volume" :: waited 0.033s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:43 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd946003-6626-4064-a493-1fd4785831d4]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e5107f26-f741-41c2-961f-5b9a145583fc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:44 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e5107f26-f741-41c2-961f-5b9a145583fc Sep 28 17:15:44 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:44 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e5107f26-f741-41c2-961f-5b9a145583fc" returned: 0 in 0.824s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e5107f26-f741-41c2-961f-5b9a145583fc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:44 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e5107f26-f741-41c2-961f-5b9a145583fc Sep 28 17:15:44 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:45 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e5107f26-f741-41c2-961f-5b9a145583fc" returned: 0 in 0.504s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] Lock "cinder-quobyte-e5107f26-f741-41c2-961f-5b9a145583fc" released by "delete_volume" :: held 1.418s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:45 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] Created reservations ['bbf8d0af-4967-4d3c-b53b-ef88a03addf6', 'efd16ba0-57ef-4cad-b20d-a924c635ec17', 'aa6edebc-6844-454a-942c-34c552507d2b', 'f2f0c0fc-5c93-4038-8586-1d0c8ffd2e9d'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:45 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:45 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:45 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:15:45 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:45 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.417s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:45 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:45 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] Deleted volume successfully. Sep 28 17:15:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-73f3c19c-8e8f-4f37-ad3c-eedeb2b76aab tempest-VolumesListTestJSON-1943127706 None] Lock "cinder-e5107f26-f741-41c2-961f-5b9a145583fc-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Flow 'volume_create_manager' (cb1b9845-768d-4128-ae42-53b242e17d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d606ab8-c893-492f-844f-66b026f4e9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d606ab8-c893-492f-844f-66b026f4e9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-553625886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030a3734-79b9-4c0a-a68c-199dcb2d3638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ad2f629619343f2af59aea81d535cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:50Z,use_quota=True,user_id='c4941df7ff5741589c526b5f900e8b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490d3ff9-74a4-4895-a67f-0bd6c8b62fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490d3ff9-74a4-4895-a67f-0bd6c8b62fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f8df5c-478c-4e43-91c3-a39106ef6df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f8df5c-478c-4e43-91c3-a39106ef6df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '030a3734-79b9-4c0a-a68c-199dcb2d3638', 'volume_name': 'volume-030a3734-79b9-4c0a-a68c-199dcb2d3638', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba46825a-dbca-4951-bb7f-1f945a6f0fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba46825a-dbca-4951-bb7f-1f945a6f0fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7cd88f9-ad51-4ffd-9244-963fc584c2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:49 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Volume 030a3734-79b9-4c0a-a68c-199dcb2d3638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-030a3734-79b9-4c0a-a68c-199dcb2d3638', 'volume_size': 1} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-553625886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030a3734-79b9-4c0a-a68c-199dcb2d3638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ad2f629619343f2af59aea81d535cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:50Z,use_quota=True,user_id='c4941df7ff5741589c526b5f900e8b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Creating volume 030a3734-79b9-4c0a-a68c-199dcb2d3638 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:49 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:15:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:50 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 1073741824 Sep 28 17:15:50 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:50 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 1073741824" returned: 0 in 0.887s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:50 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 Sep 28 17:15:50 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:51 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638" returned: 0 in 0.603s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7cd88f9-ad51-4ffd-9244-963fc584c2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-030a3734-79b9-4c0a-a68c-199dcb2d3638', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314fd2ea-6cb6-4958-ad46-72af28b8b43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:51 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Volume volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 (030a3734-79b9-4c0a-a68c-199dcb2d3638): created successfully Sep 28 17:15:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314fd2ea-6cb6-4958-ad46-72af28b8b43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Flow 'volume_create_manager' (cb1b9845-768d-4128-ae42-53b242e17d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:51 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-c624a933-dfe2-4039-b898-962e70c48042 tempest-VolumeDependencyTests-193808842 None] Created volume successfully. Sep 28 17:15:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] Creating offline snapshot 8af98cdc-a8c1-4728-8c9e-37e027900a51 of volume 030a3734-79b9-4c0a-a68c-199dcb2d3638 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:15:52 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[d871b630-8440-4084-8675-b92f52340aac]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:52 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 Sep 28 17:15:52 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:53 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638" returned: 0 in 0.769s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:53 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51 1G Sep 28 17:15:53 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:53 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Flow 'volume_create_manager' (10e5b33d-4c01-43c3-8728-f462e5296db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd09289-d05f-4d10-8eba-b5201f272e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd09289-d05f-4d10-8eba-b5201f272e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1864215728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abdacc92-e5bb-40c1-b5c8-4417842883d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2711defbf84147f79d47911b7980cead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:54Z,use_quota=True,user_id='aeb4bd8d07ee4a48aab2b624e67a101d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08151ad2-e54e-4e3c-8322-238e1dbc3997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:53 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08151ad2-e54e-4e3c-8322-238e1dbc3997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1344c88c-2d3b-468d-a3be-8c1ab6aa5568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1344c88c-2d3b-468d-a3be-8c1ab6aa5568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abdacc92-e5bb-40c1-b5c8-4417842883d5', 'volume_name': 'volume-abdacc92-e5bb-40c1-b5c8-4417842883d5', 'volume_size': 2}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f625d7-f403-4aa1-9dc8-9a3ab4faaf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f625d7-f403-4aa1-9dc8-9a3ab4faaf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda27270-5461-4bc7-b234-8e519cafea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:54 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Volume abdacc92-e5bb-40c1-b5c8-4417842883d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abdacc92-e5bb-40c1-b5c8-4417842883d5', 'volume_size': 2} Sep 28 17:15:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51 1G" returned: 0 in 0.734s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:54 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51 Sep 28 17:15:54 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:54 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51" returned: 0 in 0.398s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:54 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51 is being set with open permissions: ugo+rw Sep 28 17:15:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:54 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51 Sep 28 17:15:54 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:54 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51" returned: 0 in 0.314s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:54 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.info Sep 28 17:15:54 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:55 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.info" returned: 0 in 0.337s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:55 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.info is being set with open permissions: ugo+rw Sep 28 17:15:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:55 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.info Sep 28 17:15:55 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:55 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.info" returned: 0 in 0.358s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.054s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1864215728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abdacc92-e5bb-40c1-b5c8-4417842883d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2711defbf84147f79d47911b7980cead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:54Z,use_quota=True,user_id='aeb4bd8d07ee4a48aab2b624e67a101d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Creating volume abdacc92-e5bb-40c1-b5c8-4417842883d5 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:55 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:15:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5 2147483648 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:55 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5 2147483648 Sep 28 17:15:55 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:55 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-369033f6-a1ad-48f9-a3b9-82d7a1d7f9d1 tempest-VolumeDependencyTests-193808842 None] Create snapshot completed successfully Sep 28 17:15:56 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5 2147483648" returned: 0 in 0.837s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:56 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5 Sep 28 17:15:56 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:57 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5" returned: 0 in 0.612s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda27270-5461-4bc7-b234-8e519cafea14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abdacc92-e5bb-40c1-b5c8-4417842883d5', 'volume_size': 2}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25ca190-b848-4389-ae22-2afc26f42175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:57 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Volume volume-abdacc92-e5bb-40c1-b5c8-4417842883d5 (abdacc92-e5bb-40c1-b5c8-4417842883d5): created successfully Sep 28 17:15:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25ca190-b848-4389-ae22-2afc26f42175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Flow 'volume_create_manager' (10e5b33d-4c01-43c3-8728-f462e5296db3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:57 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-fef3de02-9876-47a7-8f65-1af2a084ba80 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Created volume successfully. Sep 28 17:15:57 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Flow 'volume_create_manager' (c88b515e-f672-45c7-be39-4572b349d977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5e36f2-2596-4223-bda3-f7ad4aa73ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5e36f2-2596-4223-bda3-f7ad4aa73ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-681307471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabc1d1a-db2b-48f2-a18e-1ae862ee76e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ad2f629619343f2af59aea81d535cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8af98cdc-a8c1-4728-8c9e-37e027900a51,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:58Z,use_quota=True,user_id='c4941df7ff5741589c526b5f900e8b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63e9b16-c50f-4028-ad89-3163954080d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63e9b16-c50f-4028-ad89-3163954080d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c3a2fb-9524-478e-ad61-394ec4e089af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c3a2fb-9524-478e-ad61-394ec4e089af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aabc1d1a-db2b-48f2-a18e-1ae862ee76e1', 'volume_name': 'volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1', 'volume_size': 1, 'snapshot_id': '8af98cdc-a8c1-4728-8c9e-37e027900a51'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c851c4-7511-446a-874a-0db6485318f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c851c4-7511-446a-874a-0db6485318f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e883e07-87f2-4d29-9261-81de9a0bc709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:58 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Volume aabc1d1a-db2b-48f2-a18e-1ae862ee76e1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1', 'volume_size': 1, 'snapshot_id': '8af98cdc-a8c1-4728-8c9e-37e027900a51'} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Acquiring lock "cinder-quobyte-8af98cdc-a8c1-4728-8c9e-37e027900a51-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1" by "_create_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-quobyte-8af98cdc-a8c1-4728-8c9e-37e027900a51-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Creating volume aabc1d1a-db2b-48f2-a18e-1ae862ee76e1 from snapshot 8af98cdc-a8c1-4728-8c9e-37e027900a51 {{(pid=86970) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Acquiring lock "cinder-quobyte-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1" by "_copy_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-quobyte-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] snapshot: 8af98cdc-a8c1-4728-8c9e-37e027900a51, volume: aabc1d1a-db2b-48f2-a18e-1ae862ee76e1, {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c3efde-e5d6-4159-98f6-d71d739300ac]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:58 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51 Sep 28 17:15:58 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:59 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51" returned: 0 in 0.800s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-030a3734-79b9-4c0a-a68c-199dcb2d3638(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:15:59 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa17ef0f-e405-457c-949a-4ac000fbd132]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:59 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 Sep 28 17:15:59 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:59 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638" returned: 0 in 0.558s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:15:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Creating direct copy from snapshot {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:15:59 devstack cinder-volume[86970]: DEBUG cinder.utils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Path /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1 not found in is_blk_device check {{(pid=86970) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:15:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:59 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1 Sep 28 17:15:59 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:16:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:01 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:16:01 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:01 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.822s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:02 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:16:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:16:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:16:08 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=110,cinder:INSERT=29,cinder:UPDATE=138,cinder:DELETE=14 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:16:09 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1" returned: 0 in 9.657s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:09 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Image conversion details: src /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638, size 1024.00 MB, duration 9.66 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1 {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:16:09 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Converted 1024.00 MB image at 106.02 MB/s Sep 28 17:16:09 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1 is being set with open permissions: ugo+rw Sep 28 17:16:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:09 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1 Sep 28 17:16:09 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:09 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1" returned: 0 in 0.324s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-quobyte-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1" released by "_copy_volume_from_snapshot" :: held 11.546s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:09 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=92,cinder:INSERT=41,cinder:UPDATE=161,cinder:DELETE=13 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:16:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-quobyte-8af98cdc-a8c1-4728-8c9e-37e027900a51-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1" released by "_create_volume_from_snapshot" :: held 11.670s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.709s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.935s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Creating offline snapshot 94eb0099-55b3-4f99-bc88-190eea28987f of volume abdacc92-e5bb-40c1-b5c8-4417842883d5 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:16:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e883e07-87f2-4d29-9261-81de9a0bc709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1', 'volume_size': 1, 'snapshot_id': '8af98cdc-a8c1-4728-8c9e-37e027900a51'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da4b6a8-28e0-4322-a75d-c1573f6782d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:09 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[6984125f-f4f2-4720-9058-5c3157dc0bf6]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:09 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Volume volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1 (aabc1d1a-db2b-48f2-a18e-1ae862ee76e1): created successfully Sep 28 17:16:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da4b6a8-28e0-4322-a75d-c1573f6782d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Flow 'volume_create_manager' (c88b515e-f672-45c7-be39-4572b349d977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:09 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-17bb3212-00be-480d-91dc-8f561872e2c2 tempest-VolumeDependencyTests-193808842 None] Created volume successfully. Sep 28 17:16:09 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5 Sep 28 17:16:09 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:10 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5" returned: 0 in 0.439s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f 2G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:10 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f 2G Sep 28 17:16:10 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] Acquiring lock "cinder-8af98cdc-a8c1-4728-8c9e-37e027900a51-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-8af98cdc-a8c1-4728-8c9e-37e027900a51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] Acquiring lock "cinder-quobyte-030a3734-79b9-4c0a-a68c-199dcb2d3638" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-quobyte-030a3734-79b9-4c0a-a68c-199dcb2d3638" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] Acquiring lock "cinder-quobyte-8af98cdc-a8c1-4728-8c9e-37e027900a51" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-quobyte-8af98cdc-a8c1-4728-8c9e-37e027900a51" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] Deleting offline snapshot 8af98cdc-a8c1-4728-8c9e-37e027900a51 of volume 030a3734-79b9-4c0a-a68c-199dcb2d3638 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:16:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] snapshot_file for this snap is: volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:16:10 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b366dbe9-587f-4123-855b-375cc76a84c7]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:10 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51 Sep 28 17:16:10 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:10 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f 2G" returned: 0 in 0.725s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abdacc92-e5bb-40c1-b5c8-4417842883d5 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:11 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abdacc92-e5bb-40c1-b5c8-4417842883d5 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f Sep 28 17:16:11 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:11 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51" returned: 0 in 0.593s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-030a3734-79b9-4c0a-a68c-199dcb2d3638(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:11 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29b5157-ced3-4892-bc1e-bfc9db0a2928]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:11 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 Sep 28 17:16:11 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:11 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abdacc92-e5bb-40c1-b5c8-4417842883d5 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f" returned: 0 in 0.549s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:11 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f is being set with open permissions: ugo+rw Sep 28 17:16:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:11 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f Sep 28 17:16:11 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:11 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f" returned: 0 in 0.400s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:12 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.info Sep 28 17:16:12 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:12 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638" returned: 0 in 0.831s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:12 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51 Sep 28 17:16:12 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:12 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.info" returned: 0 in 0.471s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:12 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.info is being set with open permissions: ugo+rw Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:12 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.info Sep 28 17:16:12 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Flow 'volume_create_manager' (75e83b5d-5f99-46e3-bad8-578294ca3f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca6e447-4a3a-41ed-b038-cab34e4520d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca6e447-4a3a-41ed-b038-cab34e4520d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1134754463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea112da-1363-4d67-b1de-7a611c8db3a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae02f31dcd36408fb17181c7a4288622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:13Z,use_quota=True,user_id='aa3b34192a7f4411a669c1bd5fa111a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837234ea-64a2-4885-bb04-b3eecf174715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837234ea-64a2-4885-bb04-b3eecf174715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c136056b-6766-4ed6-9eb0-336ec0fabbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c136056b-6766-4ed6-9eb0-336ec0fabbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea112da-1363-4d67-b1de-7a611c8db3a9', 'volume_name': 'volume-eea112da-1363-4d67-b1de-7a611c8db3a9', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6b3a5f-790d-4c10-961f-dc7cecbbc5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6b3a5f-790d-4c10-961f-dc7cecbbc5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42e17d1-3011-475b-9c96-bfac849a5cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:12 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Volume eea112da-1363-4d67-b1de-7a611c8db3a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea112da-1363-4d67-b1de-7a611c8db3a9', 'volume_size': 1} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:12 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51" returned: 0 in 0.727s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:12 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51 Sep 28 17:16:12 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:12 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.info" returned: 0 in 0.436s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.173s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.166s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1134754463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea112da-1363-4d67-b1de-7a611c8db3a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae02f31dcd36408fb17181c7a4288622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:13Z,use_quota=True,user_id='aa3b34192a7f4411a669c1bd5fa111a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Creating volume eea112da-1363-4d67-b1de-7a611c8db3a9 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:12 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:16:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea112da-1363-4d67-b1de-7a611c8db3a9 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:13 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea112da-1363-4d67-b1de-7a611c8db3a9 1073741824 Sep 28 17:16:13 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:13 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-cd7f480c-cb6d-4714-87cd-9be1ce7c53fc tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Create snapshot completed successfully Sep 28 17:16:13 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638.8af98cdc-a8c1-4728-8c9e-37e027900a51" returned: 0 in 0.427s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-quobyte-8af98cdc-a8c1-4728-8c9e-37e027900a51" released by "_delete_snapshot" :: held 2.793s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-quobyte-030a3734-79b9-4c0a-a68c-199dcb2d3638" released by "delete_snapshot" :: held 2.826s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:13 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] Created reservations ['fef0d59c-067a-411d-9087-06b26ad40b7f', '904a073a-5023-493a-9376-b0902d148f90', 'c0ad6d46-2ac8-460f-9c92-8253f82eda52', 'de656015-d1fa-41cb-9239-22d646d529d9'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:13 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] Delete snapshot completed successfully. Sep 28 17:16:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1e298dbb-738b-4330-aec3-42170bb862d2 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-8af98cdc-a8c1-4728-8c9e-37e027900a51-delete_snapshot" released by "delete_snapshot" :: held 3.147s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:13 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea112da-1363-4d67-b1de-7a611c8db3a9 1073741824" returned: 0 in 0.958s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] Acquiring lock "cinder-030a3734-79b9-4c0a-a68c-199dcb2d3638-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-030a3734-79b9-4c0a-a68c-199dcb2d3638-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] Acquiring lock "cinder-quobyte-030a3734-79b9-4c0a-a68c-199dcb2d3638" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea112da-1363-4d67-b1de-7a611c8db3a9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:14 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea112da-1363-4d67-b1de-7a611c8db3a9 Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-quobyte-030a3734-79b9-4c0a-a68c-199dcb2d3638" acquired by "delete_volume" :: waited 0.054s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:14 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Acquiring lock "cinder-94eb0099-55b3-4f99-bc88-190eea28987f-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "cinder-94eb0099-55b3-4f99-bc88-190eea28987f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Acquiring lock "cinder-quobyte-abdacc92-e5bb-40c1-b5c8-4417842883d5" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff62462-2cfd-491b-b27d-0f7e4576ccc3]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "cinder-quobyte-abdacc92-e5bb-40c1-b5c8-4417842883d5" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Acquiring lock "cinder-quobyte-94eb0099-55b3-4f99-bc88-190eea28987f" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "cinder-quobyte-94eb0099-55b3-4f99-bc88-190eea28987f" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Deleting offline snapshot 94eb0099-55b3-4f99-bc88-190eea28987f of volume abdacc92-e5bb-40c1-b5c8-4417842883d5 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] snapshot_file for this snap is: volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c1d65f-1900-4ff3-9ef9-b073f19a9a17]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:14 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 Sep 28 17:16:14 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:14 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f Sep 28 17:16:14 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:14 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea112da-1363-4d67-b1de-7a611c8db3a9" returned: 0 in 0.467s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42e17d1-3011-475b-9c96-bfac849a5cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea112da-1363-4d67-b1de-7a611c8db3a9', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0870b8-4e54-4072-ab8d-7d0c8c616a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:14 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Volume volume-eea112da-1363-4d67-b1de-7a611c8db3a9 (eea112da-1363-4d67-b1de-7a611c8db3a9): created successfully Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0870b8-4e54-4072-ab8d-7d0c8c616a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Flow 'volume_create_manager' (75e83b5d-5f99-46e3-bad8-578294ca3f52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:14 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3e9386e1-37e9-4051-8816-116b32b57902 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Created volume successfully. Sep 28 17:16:14 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638" returned: 0 in 0.713s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:14 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638 Sep 28 17:16:14 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:14 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f" returned: 0 in 0.644s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:14 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abdacc92-e5bb-40c1-b5c8-4417842883d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:15 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be02afa-46db-4e7a-a318-6f25437b0ef8]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:15 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5 Sep 28 17:16:15 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:15 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-030a3734-79b9-4c0a-a68c-199dcb2d3638" returned: 0 in 0.392s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-quobyte-030a3734-79b9-4c0a-a68c-199dcb2d3638" released by "delete_volume" :: held 1.233s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:15 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] Created reservations ['67e58ac2-33b0-4a41-8755-024209eb8010', '43ac9b4c-d5c8-4562-bd20-e8a1a4528883', 'e920ffed-023f-4853-8980-76e75a1e7840', '99ad2191-36a7-4271-baa6-1162934a3283'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:15 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:16:15 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:15 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5" returned: 0 in 0.542s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:15 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f Sep 28 17:16:15 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:16 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.578s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:16 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:16 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] Deleted volume successfully. Sep 28 17:16:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b308f17e-4142-4676-a435-60d527b0de20 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-030a3734-79b9-4c0a-a68c-199dcb2d3638-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:16 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f" returned: 0 in 0.790s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:16 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f Sep 28 17:16:16 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:16 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] Acquiring lock "cinder-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5.94eb0099-55b3-4f99-bc88-190eea28987f" returned: 0 in 0.504s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "cinder-quobyte-94eb0099-55b3-4f99-bc88-190eea28987f" released by "_delete_snapshot" :: held 2.747s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "cinder-quobyte-abdacc92-e5bb-40c1-b5c8-4417842883d5" released by "delete_snapshot" :: held 2.800s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] Acquiring lock "cinder-quobyte-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-quobyte-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1" acquired by "delete_volume" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:17 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[519f9822-eef8-45db-b5fe-a652ba0c1a51]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:17 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Created reservations ['c9ddc398-762f-4362-b528-56c3002be94e', 'abcc7a18-addc-45a0-9e42-ef4d768a7459', 'e31f3998-d362-4ff7-b581-679d77dd2374', '9d28c33c-3c32-4a79-83eb-9892bb0883ae'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:17 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1 Sep 28 17:16:17 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:17 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Delete snapshot completed successfully. Sep 28 17:16:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1312eceb-a25a-4a20-b0ac-1626cfc7ee24 tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "cinder-94eb0099-55b3-4f99-bc88-190eea28987f-delete_snapshot" released by "delete_snapshot" :: held 3.436s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Acquiring lock "cinder-abdacc92-e5bb-40c1-b5c8-4417842883d5-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "cinder-abdacc92-e5bb-40c1-b5c8-4417842883d5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:18 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Acquiring lock "cinder-quobyte-abdacc92-e5bb-40c1-b5c8-4417842883d5" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:18 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "cinder-quobyte-abdacc92-e5bb-40c1-b5c8-4417842883d5" acquired by "delete_volume" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:18 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0041eb-a03f-4204-84d7-a034ccdebe40]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:18 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1" returned: 0 in 1.143s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:18 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1 Sep 28 17:16:18 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:18 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5 Sep 28 17:16:18 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-829150d0-55c3-4b20-b238-fb964438fcc5 req-0a8ea903-66f3-41c3-a397-aab9656369f2 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-829150d0-55c3-4b20-b238-fb964438fcc5 req-0a8ea903-66f3-41c3-a397-aab9656369f2 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-829150d0-55c3-4b20-b238-fb964438fcc5 req-0a8ea903-66f3-41c3-a397-aab9656369f2 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.053s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-829150d0-55c3-4b20-b238-fb964438fcc5 req-0a8ea903-66f3-41c3-a397-aab9656369f2 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-eea112da-1363-4d67-b1de-7a611c8db3a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82a05647-259c-45a0-914e-c06c4b14a36c', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:16:18 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-829150d0-55c3-4b20-b238-fb964438fcc5 req-0a8ea903-66f3-41c3-a397-aab9656369f2 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] attachment_update completed successfully. Sep 28 17:16:18 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1" returned: 0 in 0.584s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:18 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-quobyte-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1" released by "delete_volume" :: held 1.849s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:19 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5" returned: 0 in 0.793s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:19 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5 Sep 28 17:16:19 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] Created reservations ['c54edb8f-3a52-478c-8133-4f6fd186c6b1', '24944c46-dd12-4e2f-8499-408a2e4b33b5', 'cef2c095-7bcd-4d4e-9e2d-d2d3434f98c4', 'ddd9a577-e406-4fc5-9110-b84259235e72'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:19 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:16:19 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:19 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-abdacc92-e5bb-40c1-b5c8-4417842883d5" returned: 0 in 0.473s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "cinder-quobyte-abdacc92-e5bb-40c1-b5c8-4417842883d5" released by "delete_volume" :: held 1.466s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Created reservations ['7d7aba61-53c9-4d14-8788-932d24b581c8', 'b5143718-db55-400b-8d42-4c97051a3b8a', '2665fcaf-e7b7-4bb3-b1a2-3875cadfe5ab', '5218c315-245b-40f2-91d8-918ea5c6f353'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:19 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.438s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:19 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] Deleted volume successfully. Sep 28 17:16:19 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:16:19 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-92fd198b-931f-4683-9e81-fee8e6cdad82 tempest-VolumeDependencyTests-193808842 None] Lock "cinder-aabc1d1a-db2b-48f2-a18e-1ae862ee76e1-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:20 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.428s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:20 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:20 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Deleted volume successfully. Sep 28 17:16:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8a7ffc24-95a7-436d-989f-e25f9480e33c tempest-VolumesSnapshotNegativeTestJSON-1194768521 None] Lock "cinder-abdacc92-e5bb-40c1-b5c8-4417842883d5-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:25 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-881702b5-78c8-4bd0-9147-017e5e59ebb4 req-43070d65-5e03-45cc-85b0-ff2027ca82af tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Terminate volume connection completed successfully. Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-881702b5-78c8-4bd0-9147-017e5e59ebb4 req-43070d65-5e03-45cc-85b0-ff2027ca82af tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Deleting attachment 82a05647-259c-45a0-914e-c06c4b14a36c. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Flow 'volume_create_manager' (042bd222-c101-4fe4-bb98-c3c954196010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8d3125-144a-4691-bff5-08a7732913ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8d3125-144a-4691-bff5-08a7732913ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-3647216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39e18c3-9a37-4c75-a183-fecef7da9f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97eae3c174b54586b07032cb848aa1d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:26Z,use_quota=True,user_id='fff0b3d9e95d47a0bf06a2a464f7be8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8339011f-f500-4ba3-8839-222a267e1acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8339011f-f500-4ba3-8839-222a267e1acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69abf223-b04e-4908-b90e-12a8c02a44a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69abf223-b04e-4908-b90e-12a8c02a44a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b39e18c3-9a37-4c75-a183-fecef7da9f12', 'volume_name': 'volume-b39e18c3-9a37-4c75-a183-fecef7da9f12', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d12ff08-5e99-48aa-adee-1cc55c11abb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d12ff08-5e99-48aa-adee-1cc55c11abb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c382bbe2-f175-459a-83a7-ec40976b0daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:25 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Volume b39e18c3-9a37-4c75-a183-fecef7da9f12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b39e18c3-9a37-4c75-a183-fecef7da9f12', 'volume_size': 1} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-3647216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39e18c3-9a37-4c75-a183-fecef7da9f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97eae3c174b54586b07032cb848aa1d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:26Z,use_quota=True,user_id='fff0b3d9e95d47a0bf06a2a464f7be8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Creating volume b39e18c3-9a37-4c75-a183-fecef7da9f12 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:25 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:16:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b39e18c3-9a37-4c75-a183-fecef7da9f12 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:25 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b39e18c3-9a37-4c75-a183-fecef7da9f12 1073741824 Sep 28 17:16:25 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:26 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b39e18c3-9a37-4c75-a183-fecef7da9f12 1073741824" returned: 0 in 0.885s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b39e18c3-9a37-4c75-a183-fecef7da9f12 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:26 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b39e18c3-9a37-4c75-a183-fecef7da9f12 Sep 28 17:16:26 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Acquiring lock "cinder-eea112da-1363-4d67-b1de-7a611c8db3a9-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Lock "cinder-eea112da-1363-4d67-b1de-7a611c8db3a9-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Acquiring lock "cinder-quobyte-eea112da-1363-4d67-b1de-7a611c8db3a9" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Lock "cinder-quobyte-eea112da-1363-4d67-b1de-7a611c8db3a9" acquired by "delete_volume" :: waited 0.034s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:27 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b39e18c3-9a37-4c75-a183-fecef7da9f12" returned: 0 in 0.657s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:27 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[6128f9f7-939e-4ac6-9a6c-be69951acfaa]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea112da-1363-4d67-b1de-7a611c8db3a9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c382bbe2-f175-459a-83a7-ec40976b0daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b39e18c3-9a37-4c75-a183-fecef7da9f12', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260df538-cbca-4100-83c2-39e262be9729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:27 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Volume volume-b39e18c3-9a37-4c75-a183-fecef7da9f12 (b39e18c3-9a37-4c75-a183-fecef7da9f12): created successfully Sep 28 17:16:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260df538-cbca-4100-83c2-39e262be9729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Flow 'volume_create_manager' (042bd222-c101-4fe4-bb98-c3c954196010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:27 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-32a4708b-86d5-4992-8d5d-61f4b3842e8b tempest-TestMinimumBasicScenario-772191443 None] Created volume successfully. Sep 28 17:16:27 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea112da-1363-4d67-b1de-7a611c8db3a9 Sep 28 17:16:27 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:28 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea112da-1363-4d67-b1de-7a611c8db3a9" returned: 0 in 0.875s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea112da-1363-4d67-b1de-7a611c8db3a9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:28 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea112da-1363-4d67-b1de-7a611c8db3a9 Sep 28 17:16:28 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:29 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eea112da-1363-4d67-b1de-7a611c8db3a9" returned: 0 in 0.676s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Lock "cinder-quobyte-eea112da-1363-4d67-b1de-7a611c8db3a9" released by "delete_volume" :: held 1.640s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:29 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Created reservations ['33052d6d-e47f-4aee-831d-e4fdc174d0da', 'c0d05c63-734f-4a13-a10d-4eaf9d76126a', '1c30a262-ca34-45b1-a534-7a8501fd2fef', 'df404c9b-8066-44e3-94a2-5056c090ab52'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:29 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:16:29 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:30 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.771s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:30 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:30 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Deleted volume successfully. Sep 28 17:16:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d6aec2f3-82aa-4a95-9bd7-18dc6dc7af95 tempest-TestServerVolumeAttachScenarioOldVersion-1317675771 None] Lock "cinder-eea112da-1363-4d67-b1de-7a611c8db3a9-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-22126d48-5c21-4cea-a4e6-3a5b2944b88f req-9c931f41-e07e-4e76-b8bd-b794392e7203 tempest-TestMinimumBasicScenario-772191443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-22126d48-5c21-4cea-a4e6-3a5b2944b88f req-9c931f41-e07e-4e76-b8bd-b794392e7203 tempest-TestMinimumBasicScenario-772191443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-22126d48-5c21-4cea-a4e6-3a5b2944b88f req-9c931f41-e07e-4e76-b8bd-b794392e7203 tempest-TestMinimumBasicScenario-772191443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-22126d48-5c21-4cea-a4e6-3a5b2944b88f req-9c931f41-e07e-4e76-b8bd-b794392e7203 tempest-TestMinimumBasicScenario-772191443 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-b39e18c3-9a37-4c75-a183-fecef7da9f12', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '867425a4-3431-4a64-a039-e3bb946d9bbf', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:16:31 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-22126d48-5c21-4cea-a4e6-3a5b2944b88f req-9c931f41-e07e-4e76-b8bd-b794392e7203 tempest-TestMinimumBasicScenario-772191443 None] attachment_update completed successfully. Sep 28 17:16:41 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=56,cinder:UPDATE=63,cinder:DELETE=4,cinder:INSERT=11 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:16:41 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:UPDATE=48,cinder:SELECT=50,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:16:51 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Flow 'volume_create_manager' (62e1b6aa-d45e-44b0-b6d0-228218345c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df25e65-72c5-415a-965a-b24678fb5ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df25e65-72c5-415a-965a-b24678fb5ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-223260564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed530c4f-527d-48d3-9c91-4a30284bca2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75783d41f4734c089e7c5593df0f1f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:52Z,use_quota=True,user_id='dc07aa61407640938b3292b90e527330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279bc8f4-3f40-47d3-992e-f5b0600ef97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279bc8f4-3f40-47d3-992e-f5b0600ef97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8820c8-45dc-4ffc-a3cf-4a7dcbd0e93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8820c8-45dc-4ffc-a3cf-4a7dcbd0e93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed530c4f-527d-48d3-9c91-4a30284bca2e', 'volume_name': 'volume-ed530c4f-527d-48d3-9c91-4a30284bca2e', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef8e36c3-dbf0-4071-85ad-05ac300f7977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef8e36c3-dbf0-4071-85ad-05ac300f7977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c3c2e2-02d6-43c9-883e-1902855bbd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:52 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Volume ed530c4f-527d-48d3-9c91-4a30284bca2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed530c4f-527d-48d3-9c91-4a30284bca2e', 'volume_size': 1} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-223260564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed530c4f-527d-48d3-9c91-4a30284bca2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75783d41f4734c089e7c5593df0f1f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:52Z,use_quota=True,user_id='dc07aa61407640938b3292b90e527330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Creating volume ed530c4f-527d-48d3-9c91-4a30284bca2e {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:52 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ed530c4f-527d-48d3-9c91-4a30284bca2e 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:52 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ed530c4f-527d-48d3-9c91-4a30284bca2e 1073741824 Sep 28 17:16:52 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:52 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ed530c4f-527d-48d3-9c91-4a30284bca2e 1073741824" returned: 0 in 0.651s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ed530c4f-527d-48d3-9c91-4a30284bca2e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:52 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ed530c4f-527d-48d3-9c91-4a30284bca2e Sep 28 17:16:52 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:53 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ed530c4f-527d-48d3-9c91-4a30284bca2e" returned: 0 in 0.361s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c3c2e2-02d6-43c9-883e-1902855bbd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed530c4f-527d-48d3-9c91-4a30284bca2e', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88880a14-970f-416a-821c-0f1041b5ad58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:53 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Volume volume-ed530c4f-527d-48d3-9c91-4a30284bca2e (ed530c4f-527d-48d3-9c91-4a30284bca2e): created successfully Sep 28 17:16:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88880a14-970f-416a-821c-0f1041b5ad58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Flow 'volume_create_manager' (62e1b6aa-d45e-44b0-b6d0-228218345c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:53 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ac2d4b71-a064-4869-9994-54727b1e73da tempest-ProjectReaderTests-842460416 None] Created volume successfully. Sep 28 17:16:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] Acquiring lock "cinder-ed530c4f-527d-48d3-9c91-4a30284bca2e-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] Lock "cinder-ed530c4f-527d-48d3-9c91-4a30284bca2e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] Acquiring lock "cinder-quobyte-ed530c4f-527d-48d3-9c91-4a30284bca2e" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] Lock "cinder-quobyte-ed530c4f-527d-48d3-9c91-4a30284bca2e" acquired by "delete_volume" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:54 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[9790a010-be77-4c5d-b97e-3462ed62d4d9]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ed530c4f-527d-48d3-9c91-4a30284bca2e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:54 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ed530c4f-527d-48d3-9c91-4a30284bca2e Sep 28 17:16:54 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:55 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ed530c4f-527d-48d3-9c91-4a30284bca2e" returned: 0 in 0.465s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ed530c4f-527d-48d3-9c91-4a30284bca2e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:55 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ed530c4f-527d-48d3-9c91-4a30284bca2e Sep 28 17:16:55 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:55 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ed530c4f-527d-48d3-9c91-4a30284bca2e" returned: 0 in 0.327s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] Lock "cinder-quobyte-ed530c4f-527d-48d3-9c91-4a30284bca2e" released by "delete_volume" :: held 0.862s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:55 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] Created reservations ['2dc5b2d8-7c54-49a2-b436-97405874bc50', 'ee1c54b3-a716-4e09-acea-73e2dbd86542', 'c9eb9a08-f909-45f0-b802-7daad3e24d4c', '9f0b1a65-8888-4882-afec-a5f7bf05debd'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:55 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:16:55 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:56 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.441s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:56 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] Deleted volume successfully. Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ec25f116-9d38-4d37-a7ef-7882a1f24783 tempest-ProjectReaderTests-842460416 None] Lock "cinder-ed530c4f-527d-48d3-9c91-4a30284bca2e-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Flow 'volume_create_manager' (2bfe0505-cb0b-4cc9-86da-8e88e9be8014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5c4860-2a1a-4866-b30e-6cf75d8263a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5c4860-2a1a-4866-b30e-6cf75d8263a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-135186623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9923c1e2-2a58-4956-9905-8dc89369a8fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75783d41f4734c089e7c5593df0f1f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:57Z,use_quota=True,user_id='dc07aa61407640938b3292b90e527330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f407715-f409-47ac-98c9-d77b3e034883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f407715-f409-47ac-98c9-d77b3e034883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64bb3544-20fa-4243-9b76-3ccb345a682d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64bb3544-20fa-4243-9b76-3ccb345a682d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9923c1e2-2a58-4956-9905-8dc89369a8fb', 'volume_name': 'volume-9923c1e2-2a58-4956-9905-8dc89369a8fb', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275884db-4e29-46c3-bbd4-06499982da33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275884db-4e29-46c3-bbd4-06499982da33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b856aa70-c881-4300-9552-b426b86a1ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:56 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Volume 9923c1e2-2a58-4956-9905-8dc89369a8fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9923c1e2-2a58-4956-9905-8dc89369a8fb', 'volume_size': 1} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-135186623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9923c1e2-2a58-4956-9905-8dc89369a8fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75783d41f4734c089e7c5593df0f1f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:57Z,use_quota=True,user_id='dc07aa61407640938b3292b90e527330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Creating volume 9923c1e2-2a58-4956-9905-8dc89369a8fb {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:56 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:16:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9923c1e2-2a58-4956-9905-8dc89369a8fb 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:56 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9923c1e2-2a58-4956-9905-8dc89369a8fb 1073741824 Sep 28 17:16:56 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:57 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9923c1e2-2a58-4956-9905-8dc89369a8fb 1073741824" returned: 0 in 0.731s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9923c1e2-2a58-4956-9905-8dc89369a8fb {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:57 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9923c1e2-2a58-4956-9905-8dc89369a8fb Sep 28 17:16:57 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:57 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9923c1e2-2a58-4956-9905-8dc89369a8fb" returned: 0 in 0.334s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b856aa70-c881-4300-9552-b426b86a1ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9923c1e2-2a58-4956-9905-8dc89369a8fb', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6caa8cd9-5375-4120-b388-7e72a20f2670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:57 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Volume volume-9923c1e2-2a58-4956-9905-8dc89369a8fb (9923c1e2-2a58-4956-9905-8dc89369a8fb): created successfully Sep 28 17:16:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6caa8cd9-5375-4120-b388-7e72a20f2670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Flow 'volume_create_manager' (2bfe0505-cb0b-4cc9-86da-8e88e9be8014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:57 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-55af998d-e8e2-45e7-a2cc-174a3958fa11 tempest-ProjectReaderTests-842460416 None] Created volume successfully. Sep 28 17:16:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] Acquiring lock "cinder-9923c1e2-2a58-4956-9905-8dc89369a8fb-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] Lock "cinder-9923c1e2-2a58-4956-9905-8dc89369a8fb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] Acquiring lock "cinder-quobyte-9923c1e2-2a58-4956-9905-8dc89369a8fb" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] Lock "cinder-quobyte-9923c1e2-2a58-4956-9905-8dc89369a8fb" acquired by "delete_volume" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:58 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ed3d6a-a733-42c6-9edf-b5b75e753c5c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9923c1e2-2a58-4956-9905-8dc89369a8fb {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:59 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9923c1e2-2a58-4956-9905-8dc89369a8fb Sep 28 17:16:59 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:59 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9923c1e2-2a58-4956-9905-8dc89369a8fb" returned: 0 in 0.656s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9923c1e2-2a58-4956-9905-8dc89369a8fb {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:59 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9923c1e2-2a58-4956-9905-8dc89369a8fb Sep 28 17:16:59 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:00 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9923c1e2-2a58-4956-9905-8dc89369a8fb" returned: 0 in 0.500s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:00 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] Lock "cinder-quobyte-9923c1e2-2a58-4956-9905-8dc89369a8fb" released by "delete_volume" :: held 1.216s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:00 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] Created reservations ['b2ee42ad-caeb-4155-b351-4a1d887695ad', '48c2d843-c2d5-43ee-8dec-1217516735d3', '487fe0e0-7307-434d-8bb1-536c56db17e3', '037790f2-e292-44e2-97c0-6752e2873974'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:00 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:17:00 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:00 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.459s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:00 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:00 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] Deleted volume successfully. Sep 28 17:17:00 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4bfad17c-23d2-40b1-aff9-70c3edbcecbd tempest-ProjectReaderTests-842460416 None] Lock "cinder-9923c1e2-2a58-4956-9905-8dc89369a8fb-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:17:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:01 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:17:01 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:01 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.514s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:17:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:17:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Flow 'volume_create_manager' (cbd8089b-fb9a-4f61-a3fc-75a2efcccbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e76d78-f52e-4a70-becb-fb7a4b047d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e76d78-f52e-4a70-becb-fb7a4b047d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1769136053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ddb557-ca55-4fb1-b3df-dc13e2528243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75783d41f4734c089e7c5593df0f1f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:02Z,use_quota=True,user_id='dc07aa61407640938b3292b90e527330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7575964-142c-43dd-bd71-87a0b7b11cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7575964-142c-43dd-bd71-87a0b7b11cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f115ba50-ecf9-4cc1-8404-e1c08b70380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f115ba50-ecf9-4cc1-8404-e1c08b70380b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84ddb557-ca55-4fb1-b3df-dc13e2528243', 'volume_name': 'volume-84ddb557-ca55-4fb1-b3df-dc13e2528243', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfdd7897-4a1e-4126-a90c-2eefa676181c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfdd7897-4a1e-4126-a90c-2eefa676181c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bdf643-0a8f-4e09-964d-d2927751e186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:02 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Volume 84ddb557-ca55-4fb1-b3df-dc13e2528243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84ddb557-ca55-4fb1-b3df-dc13e2528243', 'volume_size': 1} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1769136053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ddb557-ca55-4fb1-b3df-dc13e2528243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75783d41f4734c089e7c5593df0f1f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:02Z,use_quota=True,user_id='dc07aa61407640938b3292b90e527330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Creating volume 84ddb557-ca55-4fb1-b3df-dc13e2528243 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:02 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:17:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-84ddb557-ca55-4fb1-b3df-dc13e2528243 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:02 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-84ddb557-ca55-4fb1-b3df-dc13e2528243 1073741824 Sep 28 17:17:02 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:03 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-84ddb557-ca55-4fb1-b3df-dc13e2528243 1073741824" returned: 0 in 0.695s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-84ddb557-ca55-4fb1-b3df-dc13e2528243 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:03 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-84ddb557-ca55-4fb1-b3df-dc13e2528243 Sep 28 17:17:03 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:03 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-84ddb557-ca55-4fb1-b3df-dc13e2528243" returned: 0 in 0.409s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bdf643-0a8f-4e09-964d-d2927751e186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84ddb557-ca55-4fb1-b3df-dc13e2528243', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5a4155-5501-4779-8cc4-377f629b4602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:03 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Volume volume-84ddb557-ca55-4fb1-b3df-dc13e2528243 (84ddb557-ca55-4fb1-b3df-dc13e2528243): created successfully Sep 28 17:17:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5a4155-5501-4779-8cc4-377f629b4602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Flow 'volume_create_manager' (cbd8089b-fb9a-4f61-a3fc-75a2efcccbc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:03 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-67de6f5e-a312-4108-a22e-e172999fe79c tempest-ProjectReaderTests-842460416 None] Created volume successfully. Sep 28 17:17:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] Acquiring lock "cinder-84ddb557-ca55-4fb1-b3df-dc13e2528243-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] Lock "cinder-84ddb557-ca55-4fb1-b3df-dc13e2528243-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] Acquiring lock "cinder-quobyte-84ddb557-ca55-4fb1-b3df-dc13e2528243" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] Lock "cinder-quobyte-84ddb557-ca55-4fb1-b3df-dc13e2528243" acquired by "delete_volume" :: waited 0.038s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:04 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b8d6e9-5c04-4c8f-af91-e23f8bd1ceda]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-84ddb557-ca55-4fb1-b3df-dc13e2528243 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:04 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-84ddb557-ca55-4fb1-b3df-dc13e2528243 Sep 28 17:17:04 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:05 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-84ddb557-ca55-4fb1-b3df-dc13e2528243" returned: 0 in 0.647s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-84ddb557-ca55-4fb1-b3df-dc13e2528243 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:05 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-84ddb557-ca55-4fb1-b3df-dc13e2528243 Sep 28 17:17:05 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:05 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-84ddb557-ca55-4fb1-b3df-dc13e2528243" returned: 0 in 0.454s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] Lock "cinder-quobyte-84ddb557-ca55-4fb1-b3df-dc13e2528243" released by "delete_volume" :: held 1.216s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:05 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] Created reservations ['a639d2cb-389a-415e-95b5-f1ced245a0c3', 'c155cef7-e857-4964-9850-cca4d7c2550c', 'c2d5a6eb-a65c-41dd-8336-563357a8b6b4', 'd3c787ee-732e-4f45-97d8-dfd14ff8dc96'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:06 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:17:06 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:06 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.372s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:06 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:06 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] Deleted volume successfully. Sep 28 17:17:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fbdabdde-4163-4e90-82f7-48de11caa1cd tempest-ProjectReaderTests-842460416 None] Lock "cinder-84ddb557-ca55-4fb1-b3df-dc13e2528243-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:07 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Flow 'volume_create_manager' (03f47931-ec02-495f-ba65-e3932e401bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1677b8-7380-4df4-8102-d6e1155d1748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1677b8-7380-4df4-8102-d6e1155d1748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-858780381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa117d5a-00b0-4b53-aa34-7a71c4a8a85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75783d41f4734c089e7c5593df0f1f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:08Z,use_quota=True,user_id='dc07aa61407640938b3292b90e527330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637160a8-8722-48b0-9644-b3ec36113012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637160a8-8722-48b0-9644-b3ec36113012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1472cd-1cd8-4d1f-8b57-bde3de9fa1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1472cd-1cd8-4d1f-8b57-bde3de9fa1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa117d5a-00b0-4b53-aa34-7a71c4a8a85f', 'volume_name': 'volume-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b77dffd-2abc-4b16-bf06-318257d56a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b77dffd-2abc-4b16-bf06-318257d56a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a635a91-4fa9-4537-83d1-b8026921f386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:08 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Volume fa117d5a-00b0-4b53-aa34-7a71c4a8a85f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f', 'volume_size': 1} Sep 28 17:17:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-858780381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa117d5a-00b0-4b53-aa34-7a71c4a8a85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75783d41f4734c089e7c5593df0f1f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:08Z,use_quota=True,user_id='dc07aa61407640938b3292b90e527330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Creating volume fa117d5a-00b0-4b53-aa34-7a71c4a8a85f {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.083s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:08 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:17:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:08 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f 1073741824 Sep 28 17:17:08 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:09 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f 1073741824" returned: 0 in 0.802s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:09 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f Sep 28 17:17:09 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Flow 'volume_create_manager' (f584621c-feb3-4918-bf08-13ca9a050d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2ed34a-1b86-4996-8a44-d5096ad6284b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2ed34a-1b86-4996-8a44-d5096ad6284b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-603772629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ceffab-d289-45ec-9f50-a66d7de4d85c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db5d86c711241ec93d1e3ea99785643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:09Z,use_quota=True,user_id='7b27f75a574c4d728814a9ec5a6f1bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c34eb459-b3f9-49ab-9f41-105451c635aa),volume_type_id=c34eb459-b3f9-49ab-9f41-105451c635aa)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:09 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7422cea-5ce3-4688-aec4-204880c944e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7422cea-5ce3-4688-aec4-204880c944e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917b7962-d4a4-4346-88a9-2d3517a72008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917b7962-d4a4-4346-88a9-2d3517a72008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03ceffab-d289-45ec-9f50-a66d7de4d85c', 'volume_name': 'volume-03ceffab-d289-45ec-9f50-a66d7de4d85c', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9f49b5-dc6e-4591-8b43-6dcab2432e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9f49b5-dc6e-4591-8b43-6dcab2432e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6eb1fd-c83f-493a-9bde-3beac3afbd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:09 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Volume 03ceffab-d289-45ec-9f50-a66d7de4d85c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03ceffab-d289-45ec-9f50-a66d7de4d85c', 'volume_size': 1} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f" returned: 0 in 0.512s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-603772629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ceffab-d289-45ec-9f50-a66d7de4d85c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db5d86c711241ec93d1e3ea99785643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:09Z,use_quota=True,user_id='7b27f75a574c4d728814a9ec5a6f1bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c34eb459-b3f9-49ab-9f41-105451c635aa),volume_type_id=c34eb459-b3f9-49ab-9f41-105451c635aa)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Creating volume 03ceffab-d289-45ec-9f50-a66d7de4d85c {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:09 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-03ceffab-d289-45ec-9f50-a66d7de4d85c 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a635a91-4fa9-4537-83d1-b8026921f386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ead645-11c8-43da-8f05-4e9813cd6368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:09 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-03ceffab-d289-45ec-9f50-a66d7de4d85c 1073741824 Sep 28 17:17:09 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:09 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Volume volume-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f (fa117d5a-00b0-4b53-aa34-7a71c4a8a85f): created successfully Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ead645-11c8-43da-8f05-4e9813cd6368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Flow 'volume_create_manager' (03f47931-ec02-495f-ba65-e3932e401bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:09 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-e3cbabc9-ab98-4c2c-bd38-9ea5b1a5bce5 tempest-ProjectReaderTests-842460416 None] Created volume successfully. Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Flow 'volume_create_manager' (41f777a8-fcb4-4fa0-b6ad-6d4f510af2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90f64e6-80d3-4e89-8480-0be286e5d1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90f64e6-80d3-4e89-8480-0be286e5d1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1530146935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccac1856-edc4-40a5-9043-c1f0486044fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db5d86c711241ec93d1e3ea99785643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:10Z,use_quota=True,user_id='7b27f75a574c4d728814a9ec5a6f1bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b873301-011b-45f3-82b9-9f233d6922dd),volume_type_id=5b873301-011b-45f3-82b9-9f233d6922dd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c7ecb50-fd26-43ec-9724-9f3bf6f1e3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c7ecb50-fd26-43ec-9724-9f3bf6f1e3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d23396-79a2-49bf-80fe-7680e38f1632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d23396-79a2-49bf-80fe-7680e38f1632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccac1856-edc4-40a5-9043-c1f0486044fb', 'volume_name': 'volume-ccac1856-edc4-40a5-9043-c1f0486044fb', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0e18ad-5b0f-4447-a95d-e16b814577dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0e18ad-5b0f-4447-a95d-e16b814577dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427ce29b-e0ce-43e1-996b-c651dc6b4fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:10 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Volume ccac1856-edc4-40a5-9043-c1f0486044fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccac1856-edc4-40a5-9043-c1f0486044fb', 'volume_size': 1} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:10 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-03ceffab-d289-45ec-9f50-a66d7de4d85c 1073741824" returned: 0 in 0.785s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-03ceffab-d289-45ec-9f50-a66d7de4d85c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:10 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-03ceffab-d289-45ec-9f50-a66d7de4d85c Sep 28 17:17:10 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:10 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-03ceffab-d289-45ec-9f50-a66d7de4d85c" returned: 0 in 0.426s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.734s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1530146935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccac1856-edc4-40a5-9043-c1f0486044fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db5d86c711241ec93d1e3ea99785643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:10Z,use_quota=True,user_id='7b27f75a574c4d728814a9ec5a6f1bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b873301-011b-45f3-82b9-9f233d6922dd),volume_type_id=5b873301-011b-45f3-82b9-9f233d6922dd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Creating volume ccac1856-edc4-40a5-9043-c1f0486044fb {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:10 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ccac1856-edc4-40a5-9043-c1f0486044fb 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6eb1fd-c83f-493a-9bde-3beac3afbd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03ceffab-d289-45ec-9f50-a66d7de4d85c', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:10 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ccac1856-edc4-40a5-9043-c1f0486044fb 1073741824 Sep 28 17:17:10 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a738a3-4b4a-48ee-bac8-8a5f7210b5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] Acquiring lock "cinder-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:11 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Volume volume-03ceffab-d289-45ec-9f50-a66d7de4d85c (03ceffab-d289-45ec-9f50-a66d7de4d85c): created successfully Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a738a3-4b4a-48ee-bac8-8a5f7210b5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Flow 'volume_create_manager' (f584621c-feb3-4918-bf08-13ca9a050d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] Lock "cinder-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:11 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-bb1bb29f-d22b-4966-bdd5-d9c52d93b787 tempest-TestInstancesWithCinderVolumes-268729189 None] Created volume successfully. Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Flow 'volume_create_manager' (93395d4f-5c36-4e9b-8d04-c587604480a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d42a61-65c8-479e-9e15-d36fd309c416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d42a61-65c8-479e-9e15-d36fd309c416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-805908627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d32fb9a-51c3-4d66-b68a-700992890950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db5d86c711241ec93d1e3ea99785643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:11Z,use_quota=True,user_id='7b27f75a574c4d728814a9ec5a6f1bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11c2550b-adc3-4ba2-90b3-9eb7e42b5760),volume_type_id=11c2550b-adc3-4ba2-90b3-9eb7e42b5760)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bbfe0a-dba7-40e5-8d71-091da1f38769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bbfe0a-dba7-40e5-8d71-091da1f38769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1da802-1c24-415b-9be1-abd4ec97342c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG cinder.image.glance [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Creating Keystone auth plugin from conf {{(pid=86970) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] Acquiring lock "cinder-quobyte-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] Lock "cinder-quobyte-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f" acquired by "delete_volume" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb6e105-9202-40e5-a1e2-8fcd0df5f555]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:11 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f Sep 28 17:17:11 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:11 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ccac1856-edc4-40a5-9043-c1f0486044fb 1073741824" returned: 0 in 0.649s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ccac1856-edc4-40a5-9043-c1f0486044fb {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:11 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ccac1856-edc4-40a5-9043-c1f0486044fb Sep 28 17:17:11 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:12 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f" returned: 0 in 0.737s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:12 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f Sep 28 17:17:12 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:12 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1da802-1c24-415b-9be1-abd4ec97342c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3d32fb9a-51c3-4d66-b68a-700992890950', 'volume_name': 'volume-3d32fb9a-51c3-4d66-b68a-700992890950', 'volume_size': 1, 'image_id': '6b237f5d-d0e0-49af-9281-2e0d98aa8dcd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b237f5d-d0e0-49af-9281-2e0d98aa8dcd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1041721716', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7db5d86c711241ec93d1e3ea99785643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b237f5d-d0e0-49af-9281-2e0d98aa8dcd', 'created_at': datetime.datetime(2026, 9, 28, 15, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 17, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b237f5d-d0e0-49af-9281-2e0d98aa8dcd/file', 'properties': {}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d370e7-232d-4890-b665-6ab14bd21c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d370e7-232d-4890-b665-6ab14bd21c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85cc8490-0fa4-455c-8f4a-f7dd0069a4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:12 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Volume 3d32fb9a-51c3-4d66-b68a-700992890950: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3d32fb9a-51c3-4d66-b68a-700992890950', 'volume_size': 1, 'image_id': '6b237f5d-d0e0-49af-9281-2e0d98aa8dcd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b237f5d-d0e0-49af-9281-2e0d98aa8dcd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1041721716', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7db5d86c711241ec93d1e3ea99785643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b237f5d-d0e0-49af-9281-2e0d98aa8dcd', 'created_at': datetime.datetime(2026, 9, 28, 15, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 17, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b237f5d-d0e0-49af-9281-2e0d98aa8dcd/file', 'properties': {}}, 'image_service': } Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Trying to clone 3d32fb9a-51c3-4d66-b68a-700992890950 from image 6b237f5d-d0e0-49af-9281-2e0d98aa8dcd at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b237f5d-d0e0-49af-9281-2e0d98aa8dcd', 'metadata': {}}]). {{(pid=86970) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ccac1856-edc4-40a5-9043-c1f0486044fb" returned: 0 in 0.687s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427ce29b-e0ce-43e1-996b-c651dc6b4fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccac1856-edc4-40a5-9043-c1f0486044fb', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6548964e-6330-4f89-8542-e6e1500ad3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:12 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Volume volume-ccac1856-edc4-40a5-9043-c1f0486044fb (ccac1856-edc4-40a5-9043-c1f0486044fb): created successfully Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6548964e-6330-4f89-8542-e6e1500ad3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Flow 'volume_create_manager' (41f777a8-fcb4-4fa0-b6ad-6d4f510af2bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:12 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-59ffc1d9-977f-478f-8171-ba693b244abc tempest-TestInstancesWithCinderVolumes-268729189 None] Created volume successfully. Sep 28 17:17:12 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f" returned: 0 in 0.598s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] Lock "cinder-quobyte-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f" released by "delete_volume" :: held 1.410s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] Created reservations ['1b623566-10c1-4fb8-8c87-4044b3c92d03', '24bb2374-68f2-4532-b6b8-6cb4ed3fc203', 'd8f388b2-d731-4c2f-8761-c73a1d23157a', '4687e14d-ea73-4ba9-95a3-f5fa6f96b6c2'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:12 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:17:12 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:13 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.340s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:13 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:13 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] Deleted volume successfully. Sep 28 17:17:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-05462a29-9950-41d7-8fec-979703dd1920 tempest-ProjectReaderTests-842460416 None] Lock "cinder-fa117d5a-00b0-4b53-aa34-7a71c4a8a85f-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:17 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_55xx5wjkdevstack@QuobyteHD, size 20.69 MB, duration 5.47 sec {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:17:17 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Image download 20.69 MB at 3.78 MB/s Sep 28 17:17:17 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e4e2c0-99df-4967-9961-cdd335b07cad]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_55xx5wjkdevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:18 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_55xx5wjkdevstack@QuobyteHD Sep 28 17:17:18 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:18 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_55xx5wjkdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:18 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Temporary image 6b237f5d-d0e0-49af-9281-2e0d98aa8dcd is fetched for user 7b27f75a574c4d728814a9ec5a6f1bff. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:17:18 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[6614d0d4-6919-410c-b56e-d2891bbbdfec]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_55xx5wjkdevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:18 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_55xx5wjkdevstack@QuobyteHD Sep 28 17:17:18 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:19 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_55xx5wjkdevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-805908627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d32fb9a-51c3-4d66-b68a-700992890950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db5d86c711241ec93d1e3ea99785643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:11Z,use_quota=True,user_id='7b27f75a574c4d728814a9ec5a6f1bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11c2550b-adc3-4ba2-90b3-9eb7e42b5760),volume_type_id=11c2550b-adc3-4ba2-90b3-9eb7e42b5760)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Creating volume 3d32fb9a-51c3-4d66-b68a-700992890950 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:19 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:17:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:19 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950 1073741824 Sep 28 17:17:19 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:19 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950 1073741824" returned: 0 in 0.630s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:19 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950 Sep 28 17:17:19 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:20 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950" returned: 0 in 0.351s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:20 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Attempting download of 6b237f5d-d0e0-49af-9281-2e0d98aa8dcd ((None, [{'url': 'file:///opt/stack/data/glance/images/6b237f5d-d0e0-49af-9281-2e0d98aa8dcd', 'metadata': {}}])) to volume 3d32fb9a-51c3-4d66-b68a-700992890950. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:17:20 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[72175ecc-a720-4cd5-9023-88579020c714]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_muvdei14 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:20 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_muvdei14 Sep 28 17:17:20 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:20 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_muvdei14" returned: 0 in 0.478s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_muvdei14 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:20 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_muvdei14 Sep 28 17:17:20 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:21 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_muvdei14" returned: 1 in 0.384s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_muvdei14' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:17:21 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db027ea-880c-4c73-a9f8-661aa6796748]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_55xx5wjkdevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:21 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_55xx5wjkdevstack@QuobyteHD Sep 28 17:17:21 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:21 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_55xx5wjkdevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:21 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] 6b237f5d-d0e0-49af-9281-2e0d98aa8dcd was qcow2, converting to qcow2 {{(pid=86970) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:17:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_55xx5wjkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:21 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_55xx5wjkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950 Sep 28 17:17:21 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:24 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_55xx5wjkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950" returned: 0 in 2.737s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:24 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b237f5d-d0e0-49af-9281-2e0d98aa8dcd_55xx5wjkdevstack@QuobyteHD, size 112.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950 {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:17:24 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Converted 112.00 MB image at 40.90 MB/s Sep 28 17:17:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:24 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950 1G Sep 28 17:17:24 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:24 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950 1G" returned: 0 in 0.440s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:24 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Downloaded image 6b237f5d-d0e0-49af-9281-2e0d98aa8dcd ((None, [{'url': 'file:///opt/stack/data/glance/images/6b237f5d-d0e0-49af-9281-2e0d98aa8dcd', 'metadata': {}}])) to volume 3d32fb9a-51c3-4d66-b68a-700992890950 successfully. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:17:24 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Temporary image 6b237f5d-d0e0-49af-9281-2e0d98aa8dcd for user 7b27f75a574c4d728814a9ec5a6f1bff is deleted. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:17:24 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Marking volume 3d32fb9a-51c3-4d66-b68a-700992890950 as bootable. {{(pid=86970) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:17:24 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Copying metadata from image 6b237f5d-d0e0-49af-9281-2e0d98aa8dcd to 3d32fb9a-51c3-4d66-b68a-700992890950. {{(pid=86970) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:17:24 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Creating volume glance metadata for volume 3d32fb9a-51c3-4d66-b68a-700992890950 backed by image 6b237f5d-d0e0-49af-9281-2e0d98aa8dcd with: {'image_id': '6b237f5d-d0e0-49af-9281-2e0d98aa8dcd', 'image_name': 'tempest-scenario-img--1041721716', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86970) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:17:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85cc8490-0fa4-455c-8f4a-f7dd0069a4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d32fb9a-51c3-4d66-b68a-700992890950', 'volume_size': 1, 'image_id': '6b237f5d-d0e0-49af-9281-2e0d98aa8dcd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b237f5d-d0e0-49af-9281-2e0d98aa8dcd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1041721716', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7db5d86c711241ec93d1e3ea99785643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b237f5d-d0e0-49af-9281-2e0d98aa8dcd', 'created_at': datetime.datetime(2026, 9, 28, 15, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 17, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b237f5d-d0e0-49af-9281-2e0d98aa8dcd/file', 'properties': {}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f778855-f96e-48e0-a475-7c6d8160e339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:24 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Volume volume-3d32fb9a-51c3-4d66-b68a-700992890950 (3d32fb9a-51c3-4d66-b68a-700992890950): created successfully Sep 28 17:17:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f778855-f96e-48e0-a475-7c6d8160e339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Flow 'volume_create_manager' (93395d4f-5c36-4e9b-8d04-c587604480a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:24 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-de5a8915-c388-44af-9bb3-df0511491185 tempest-TestInstancesWithCinderVolumes-268729189 None] Created volume successfully. Sep 28 17:17:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-622c5241-a02b-404c-8e3b-cfd8e292cee4 req-e45a76ab-533f-43ab-8dbe-e93849dcccfa tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-622c5241-a02b-404c-8e3b-cfd8e292cee4 req-e45a76ab-533f-43ab-8dbe-e93849dcccfa tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-622c5241-a02b-404c-8e3b-cfd8e292cee4 req-e45a76ab-533f-43ab-8dbe-e93849dcccfa tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-622c5241-a02b-404c-8e3b-cfd8e292cee4 req-e45a76ab-533f-43ab-8dbe-e93849dcccfa tempest-TestInstancesWithCinderVolumes-268729189 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-3d32fb9a-51c3-4d66-b68a-700992890950', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd976221c-75b0-4ed2-9837-2d4a45fd995a', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:17:30 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-622c5241-a02b-404c-8e3b-cfd8e292cee4 req-e45a76ab-533f-43ab-8dbe-e93849dcccfa tempest-TestInstancesWithCinderVolumes-268729189 None] attachment_update completed successfully. Sep 28 17:17:40 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=57,cinder:INSERT=19,cinder:UPDATE=61,cinder:DELETE=5 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:17:40 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:UPDATE=51,cinder:DELETE=6,cinder:SELECT=35,cinder:INSERT=13 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Flow 'volume_create_manager' (ee78eaae-634e-4af9-a84f-e4efd65e29de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd59c87-9d66-4760-a0a0-8b096534989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd59c87-9d66-4760-a0a0-8b096534989d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-80604628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68d84ca-2068-436d-9f06-e15358a47206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32bab24d9e544e48919108b310764a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:45Z,use_quota=True,user_id='144aed208526485db2c961f35c8c7d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97874013-865c-4e06-81fe-0a8875d5b447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97874013-865c-4e06-81fe-0a8875d5b447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166fe286-f29a-4392-8617-0c8e62d7f114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166fe286-f29a-4392-8617-0c8e62d7f114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c68d84ca-2068-436d-9f06-e15358a47206', 'volume_name': 'volume-c68d84ca-2068-436d-9f06-e15358a47206', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de400fb-972b-4b7f-823c-b1edc02513b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de400fb-972b-4b7f-823c-b1edc02513b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff93955-33e5-4faa-becf-d6e18121a4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:45 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Volume c68d84ca-2068-436d-9f06-e15358a47206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c68d84ca-2068-436d-9f06-e15358a47206', 'volume_size': 1} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-80604628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68d84ca-2068-436d-9f06-e15358a47206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32bab24d9e544e48919108b310764a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:45Z,use_quota=True,user_id='144aed208526485db2c961f35c8c7d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Creating volume c68d84ca-2068-436d-9f06-e15358a47206 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:45 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:17:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:45 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 1073741824 Sep 28 17:17:45 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:46 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 1073741824" returned: 0 in 1.076s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:46 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 Sep 28 17:17:46 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-bc2c1c33-d2a1-4369-b7b7-9f67a2ee1648 req-1a6fe62b-4732-4cce-94de-1c3a2fd25a1b tempest-TestMinimumBasicScenario-772191443 None] Terminate volume connection completed successfully. Sep 28 17:17:46 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-bc2c1c33-d2a1-4369-b7b7-9f67a2ee1648 req-1a6fe62b-4732-4cce-94de-1c3a2fd25a1b tempest-TestMinimumBasicScenario-772191443 None] Deleting attachment 867425a4-3431-4a64-a039-e3bb946d9bbf. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:17:47 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206" returned: 0 in 0.633s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:47 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:47 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff93955-33e5-4faa-becf-d6e18121a4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c68d84ca-2068-436d-9f06-e15358a47206', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:47 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8632cc7-691b-4534-9ecb-dc7edce70707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:47 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Volume volume-c68d84ca-2068-436d-9f06-e15358a47206 (c68d84ca-2068-436d-9f06-e15358a47206): created successfully Sep 28 17:17:47 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8632cc7-691b-4534-9ecb-dc7edce70707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:47 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Flow 'volume_create_manager' (ee78eaae-634e-4af9-a84f-e4efd65e29de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:47 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3e98f4ea-2eea-481e-8876-ddfe1493778c tempest-TestStampPattern-1892120815 None] Created volume successfully. Sep 28 17:17:48 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] Acquiring lock "cinder-b39e18c3-9a37-4c75-a183-fecef7da9f12-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:48 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] Lock "cinder-b39e18c3-9a37-4c75-a183-fecef7da9f12-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:48 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] Acquiring lock "cinder-quobyte-b39e18c3-9a37-4c75-a183-fecef7da9f12" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:48 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] Lock "cinder-quobyte-b39e18c3-9a37-4c75-a183-fecef7da9f12" acquired by "delete_volume" :: waited 0.038s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:48 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f47137b-f41b-4c3c-8313-b266e32eca81]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b39e18c3-9a37-4c75-a183-fecef7da9f12 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:48 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b39e18c3-9a37-4c75-a183-fecef7da9f12 Sep 28 17:17:48 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:49 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b39e18c3-9a37-4c75-a183-fecef7da9f12" returned: 0 in 0.627s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b39e18c3-9a37-4c75-a183-fecef7da9f12 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:49 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b39e18c3-9a37-4c75-a183-fecef7da9f12 Sep 28 17:17:49 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:49 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-b39e18c3-9a37-4c75-a183-fecef7da9f12" returned: 0 in 0.759s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:49 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] Lock "cinder-quobyte-b39e18c3-9a37-4c75-a183-fecef7da9f12" released by "delete_volume" :: held 1.485s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:50 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] Created reservations ['f893052e-7603-4a6c-a61d-60388ea81e5c', 'e2cb2d14-ff65-40e8-ac04-5c6839cd7845', 'b627db86-33ac-458d-8500-9762a3810d4d', 'ac3ade6e-b8d9-40d1-a7e4-eb175c97c79c'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:50 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:17:50 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:50 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.504s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:50 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:50 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] Deleted volume successfully. Sep 28 17:17:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-eb33e177-416f-417c-b82a-b19bb150b140 tempest-TestMinimumBasicScenario-772191443 None] Lock "cinder-b39e18c3-9a37-4c75-a183-fecef7da9f12-delete_volume" released by "delete_volume" :: held 2.533s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:00 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=11 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:18:00 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=10,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:18:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:18:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:01 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:18:01 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:01 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.562s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:18:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:18:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:18:12 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:18:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-498bc6e4-0f73-41ae-8f3f-f396eaf83912 req-041a816e-9aa2-4728-b282-1bb1c9b07db1 tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-498bc6e4-0f73-41ae-8f3f-f396eaf83912 req-041a816e-9aa2-4728-b282-1bb1c9b07db1 tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-498bc6e4-0f73-41ae-8f3f-f396eaf83912 req-041a816e-9aa2-4728-b282-1bb1c9b07db1 tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-498bc6e4-0f73-41ae-8f3f-f396eaf83912 req-041a816e-9aa2-4728-b282-1bb1c9b07db1 tempest-TestInstancesWithCinderVolumes-268729189 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-03ceffab-d289-45ec-9f50-a66d7de4d85c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5173e1bd-12b2-47ba-8042-394ad5e8b13d', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:18:15 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-498bc6e4-0f73-41ae-8f3f-f396eaf83912 req-041a816e-9aa2-4728-b282-1bb1c9b07db1 tempest-TestInstancesWithCinderVolumes-268729189 None] attachment_update completed successfully. Sep 28 17:18:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-e158dca0-fc1d-48e0-80b2-3950d1686331 req-1269d351-c894-476e-97f7-71e8f226fba2 tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-e158dca0-fc1d-48e0-80b2-3950d1686331 req-1269d351-c894-476e-97f7-71e8f226fba2 tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-e158dca0-fc1d-48e0-80b2-3950d1686331 req-1269d351-c894-476e-97f7-71e8f226fba2 tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-e158dca0-fc1d-48e0-80b2-3950d1686331 req-1269d351-c894-476e-97f7-71e8f226fba2 tempest-TestInstancesWithCinderVolumes-268729189 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-ccac1856-edc4-40a5-9043-c1f0486044fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4438167-9f47-4ed9-ba1b-defb6c8b9926', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:18:19 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-e158dca0-fc1d-48e0-80b2-3950d1686331 req-1269d351-c894-476e-97f7-71e8f226fba2 tempest-TestInstancesWithCinderVolumes-268729189 None] attachment_update completed successfully. Sep 28 17:18:26 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-b109e8c2-0519-41f0-b4df-477648cd47e6 req-ba1bec0e-b32d-4c77-9ddd-9d81edbc57c6 tempest-TestInstancesWithCinderVolumes-268729189 None] Terminate volume connection completed successfully. Sep 28 17:18:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-b109e8c2-0519-41f0-b4df-477648cd47e6 req-ba1bec0e-b32d-4c77-9ddd-9d81edbc57c6 tempest-TestInstancesWithCinderVolumes-268729189 None] Deleting attachment 5173e1bd-12b2-47ba-8042-394ad5e8b13d. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:18:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "cinder-03ceffab-d289-45ec-9f50-a66d7de4d85c-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "cinder-03ceffab-d289-45ec-9f50-a66d7de4d85c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "cinder-quobyte-03ceffab-d289-45ec-9f50-a66d7de4d85c" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "cinder-quobyte-03ceffab-d289-45ec-9f50-a66d7de4d85c" acquired by "delete_volume" :: waited 0.024s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:27 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7e6afb-d5e4-49dd-ba05-9f456b5a86e2]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-03ceffab-d289-45ec-9f50-a66d7de4d85c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-e2f89a66-e1fe-449c-815c-451dea21f06b req-f3001965-5850-4504-9cda-ed768558f4e9 tempest-TestStampPattern-1892120815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-e2f89a66-e1fe-449c-815c-451dea21f06b req-f3001965-5850-4504-9cda-ed768558f4e9 tempest-TestStampPattern-1892120815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-e2f89a66-e1fe-449c-815c-451dea21f06b req-f3001965-5850-4504-9cda-ed768558f4e9 tempest-TestStampPattern-1892120815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-e2f89a66-e1fe-449c-815c-451dea21f06b req-f3001965-5850-4504-9cda-ed768558f4e9 tempest-TestStampPattern-1892120815 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-c68d84ca-2068-436d-9f06-e15358a47206', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '249803ee-5e27-4aa6-8636-70e33af030c2', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:18:27 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-03ceffab-d289-45ec-9f50-a66d7de4d85c Sep 28 17:18:27 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:27 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-e2f89a66-e1fe-449c-815c-451dea21f06b req-f3001965-5850-4504-9cda-ed768558f4e9 tempest-TestStampPattern-1892120815 None] attachment_update completed successfully. Sep 28 17:18:28 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-03ceffab-d289-45ec-9f50-a66d7de4d85c" returned: 0 in 0.804s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-03ceffab-d289-45ec-9f50-a66d7de4d85c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:28 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-03ceffab-d289-45ec-9f50-a66d7de4d85c Sep 28 17:18:28 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:28 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-03ceffab-d289-45ec-9f50-a66d7de4d85c" returned: 0 in 0.526s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:28 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "cinder-quobyte-03ceffab-d289-45ec-9f50-a66d7de4d85c" released by "delete_volume" :: held 1.410s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:28 devstack cinder-volume[86970]: WARNING cinder.quota [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-905305981-1616781817 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-905305981-1616781817, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:18:28 devstack cinder-volume[86970]: WARNING cinder.quota [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-905305981-1616781817 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-905305981-1616781817, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:18:28 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Created reservations ['69237318-caca-4d62-a69e-97ca6cc19159', '67ed3456-b19b-4c34-9aa7-364af0e823e9', '2b6adce0-268a-442e-a0c9-701aacd3ffdf', '78bb3563-0228-492e-a733-c4d909d14fbd'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:28 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:18:28 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:29 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.298s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:29 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:29 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Deleted volume successfully. Sep 28 17:18:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ab3dd7fc-7cbf-44d2-8279-a80eff891d8e tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "cinder-03ceffab-d289-45ec-9f50-a66d7de4d85c-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:32 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-a6f49a64-34db-4e50-bd17-d428a4ac39dd req-fed34ede-89ba-43f5-accb-e88a8b0fb8fa tempest-TestInstancesWithCinderVolumes-268729189 None] Terminate volume connection completed successfully. Sep 28 17:18:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-a6f49a64-34db-4e50-bd17-d428a4ac39dd req-fed34ede-89ba-43f5-accb-e88a8b0fb8fa tempest-TestInstancesWithCinderVolumes-268729189 None] Deleting attachment f4438167-9f47-4ed9-ba1b-defb6c8b9926. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:18:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "cinder-ccac1856-edc4-40a5-9043-c1f0486044fb-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "cinder-ccac1856-edc4-40a5-9043-c1f0486044fb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "cinder-quobyte-ccac1856-edc4-40a5-9043-c1f0486044fb" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "cinder-quobyte-ccac1856-edc4-40a5-9043-c1f0486044fb" acquired by "delete_volume" :: waited 0.024s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:33 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ae1e32-d371-4ebc-a398-4cddc9657590]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ccac1856-edc4-40a5-9043-c1f0486044fb {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:33 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ccac1856-edc4-40a5-9043-c1f0486044fb Sep 28 17:18:33 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:33 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ccac1856-edc4-40a5-9043-c1f0486044fb" returned: 0 in 0.656s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ccac1856-edc4-40a5-9043-c1f0486044fb {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:33 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ccac1856-edc4-40a5-9043-c1f0486044fb Sep 28 17:18:33 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:34 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ccac1856-edc4-40a5-9043-c1f0486044fb" returned: 0 in 0.312s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "cinder-quobyte-ccac1856-edc4-40a5-9043-c1f0486044fb" released by "delete_volume" :: held 1.050s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:34 devstack cinder-volume[86970]: WARNING cinder.quota [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-15290837-606999272 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-15290837-606999272, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:18:34 devstack cinder-volume[86970]: WARNING cinder.quota [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-15290837-606999272 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-15290837-606999272, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:18:34 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Created reservations ['c1b8ad29-5e13-4007-b6e3-a3190f12c804', '22bdabae-30ee-492a-b80b-062cacd6bdef', 'fbbbe2ab-9929-4fcb-8ce0-19c2188a7394', 'cbaed22b-d59c-446b-b417-1d088808161a'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:34 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-a192ab86-11d8-46cc-86ea-20316f96c5ac req-9d13bf8a-785f-4682-a116-7eb5f66287fa tempest-TestStampPattern-1892120815 None] Terminate volume connection completed successfully. Sep 28 17:18:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-a192ab86-11d8-46cc-86ea-20316f96c5ac req-9d13bf8a-785f-4682-a116-7eb5f66287fa tempest-TestStampPattern-1892120815 None] Deleting attachment 249803ee-5e27-4aa6-8636-70e33af030c2. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:18:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:34 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:34 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:34 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:18:34 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:34 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.409s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:34 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:34 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Deleted volume successfully. Sep 28 17:18:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8624d85d-9c29-4104-801c-235fd166d21c tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "cinder-ccac1856-edc4-40a5-9043-c1f0486044fb-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] Creating offline snapshot eba90339-12dd-46fb-ab6e-b36e444a31a8 of volume c68d84ca-2068-436d-9f06-e15358a47206 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:18:35 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[840dbf63-2871-4a00-9a18-3b6c35ce728c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:35 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 Sep 28 17:18:35 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:35 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206" returned: 0 in 0.524s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:35 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8 1G Sep 28 17:18:35 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:36 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8 1G" returned: 0 in 0.573s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c68d84ca-2068-436d-9f06-e15358a47206 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:36 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c68d84ca-2068-436d-9f06-e15358a47206 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8 Sep 28 17:18:36 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:36 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c68d84ca-2068-436d-9f06-e15358a47206 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8" returned: 0 in 0.561s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:36 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8 is being set with open permissions: ugo+rw Sep 28 17:18:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:36 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8 Sep 28 17:18:36 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:37 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8" returned: 0 in 0.407s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:37 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.info Sep 28 17:18:37 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:37 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.info" returned: 0 in 0.557s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:37 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.info is being set with open permissions: ugo+rw Sep 28 17:18:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:38 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.info Sep 28 17:18:38 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:38 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.info" returned: 0 in 0.339s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.125s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:38 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-91c8fb85-4112-4a69-af5b-c83cb8b4dd18 tempest-TestStampPattern-1892120815 None] Create snapshot completed successfully Sep 28 17:18:38 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-37f886e1-1528-4042-b4cf-40a97dc5a116 req-9262449c-e779-406a-bc9f-b029fba3d1c6 tempest-TestInstancesWithCinderVolumes-268729189 None] Terminate volume connection completed successfully. Sep 28 17:18:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-37f886e1-1528-4042-b4cf-40a97dc5a116 req-9262449c-e779-406a-bc9f-b029fba3d1c6 tempest-TestInstancesWithCinderVolumes-268729189 None] Deleting attachment d976221c-75b0-4ed2-9837-2d4a45fd995a. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:18:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "cinder-3d32fb9a-51c3-4d66-b68a-700992890950-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "cinder-3d32fb9a-51c3-4d66-b68a-700992890950-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "cinder-quobyte-3d32fb9a-51c3-4d66-b68a-700992890950" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "cinder-quobyte-3d32fb9a-51c3-4d66-b68a-700992890950" acquired by "delete_volume" :: waited 0.018s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:39 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[866a96bd-f98a-418e-b25e-1ffc782a20fe]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:40 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950 Sep 28 17:18:40 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:40 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950" returned: 0 in 0.572s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:40 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950 Sep 28 17:18:40 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:40 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-3d32fb9a-51c3-4d66-b68a-700992890950" returned: 0 in 0.417s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "cinder-quobyte-3d32fb9a-51c3-4d66-b68a-700992890950" released by "delete_volume" :: held 1.059s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:41 devstack cinder-volume[86970]: WARNING cinder.quota [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-820285711-948565823 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-820285711-948565823, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:18:41 devstack cinder-volume[86970]: WARNING cinder.quota [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-820285711-948565823 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-820285711-948565823, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:18:41 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Created reservations ['e8080c3f-2d9d-4a9d-9e43-4f7374acde35', 'aeb43fc2-674f-42bf-a51f-79d6b3c394c0', '46f3057c-2fa9-474b-be19-3c007c795a36', '6bb0996b-3599-45ff-88d3-abee5da863e5'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:41 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:18:41 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:41 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.353s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:41 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:41 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Deleted volume successfully. Sep 28 17:18:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d9ac557f-4c5b-41b8-9857-8364836b7ccd tempest-TestInstancesWithCinderVolumes-268729189 None] Lock "cinder-3d32fb9a-51c3-4d66-b68a-700992890950-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Flow 'volume_create_manager' (c132ea80-31aa-47dc-af05-4ab6bb07fe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a4a48a-496a-4ed7-8bd6-227741185744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a4a48a-496a-4ed7-8bd6-227741185744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1861073324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c2be528-437d-4b42-99aa-64f4bd74e955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32bab24d9e544e48919108b310764a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eba90339-12dd-46fb-ab6e-b36e444a31a8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:50Z,use_quota=True,user_id='144aed208526485db2c961f35c8c7d12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62ef82b-1c27-452e-a09a-72b05f6780c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62ef82b-1c27-452e-a09a-72b05f6780c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3231a334-497d-4607-ab28-a3d9f1720fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3231a334-497d-4607-ab28-a3d9f1720fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9c2be528-437d-4b42-99aa-64f4bd74e955', 'volume_name': 'volume-9c2be528-437d-4b42-99aa-64f4bd74e955', 'volume_size': 1, 'snapshot_id': 'eba90339-12dd-46fb-ab6e-b36e444a31a8'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4867b3-0a4a-4b94-a790-3d39e0d447a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4867b3-0a4a-4b94-a790-3d39e0d447a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25bf7ded-e3eb-4990-bf03-9c5ed7715e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:49 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Volume 9c2be528-437d-4b42-99aa-64f4bd74e955: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9c2be528-437d-4b42-99aa-64f4bd74e955', 'volume_size': 1, 'snapshot_id': 'eba90339-12dd-46fb-ab6e-b36e444a31a8'} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Acquiring lock "cinder-quobyte-eba90339-12dd-46fb-ab6e-b36e444a31a8-9c2be528-437d-4b42-99aa-64f4bd74e955" by "_create_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Lock "cinder-quobyte-eba90339-12dd-46fb-ab6e-b36e444a31a8-9c2be528-437d-4b42-99aa-64f4bd74e955" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Creating volume 9c2be528-437d-4b42-99aa-64f4bd74e955 from snapshot eba90339-12dd-46fb-ab6e-b36e444a31a8 {{(pid=86970) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Acquiring lock "cinder-quobyte-9c2be528-437d-4b42-99aa-64f4bd74e955" by "_copy_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Lock "cinder-quobyte-9c2be528-437d-4b42-99aa-64f4bd74e955" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] snapshot: eba90339-12dd-46fb-ab6e-b36e444a31a8, volume: 9c2be528-437d-4b42-99aa-64f4bd74e955, {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:50 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f035ff3e-82a4-4a1b-affd-6a2ee64fa09a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:50 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8 Sep 28 17:18:50 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:50 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8" returned: 0 in 0.526s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c68d84ca-2068-436d-9f06-e15358a47206(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:18:50 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb642e8-f115-43a4-9c12-1a59c033f429]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:50 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 Sep 28 17:18:50 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:51 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206" returned: 0 in 0.484s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:18:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Creating direct copy from snapshot {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:18:51 devstack cinder-volume[86970]: DEBUG cinder.utils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Path /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c2be528-437d-4b42-99aa-64f4bd74e955 not found in is_blk_device check {{(pid=86970) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:18:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c2be528-437d-4b42-99aa-64f4bd74e955 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:51 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c2be528-437d-4b42-99aa-64f4bd74e955 Sep 28 17:18:51 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:51 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Flow 'volume_create_manager' (7b73b1fe-a848-4e74-ac68-e3ea2ac4d0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2613097d-1383-4a74-b7be-fd9c262cf0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2613097d-1383-4a74-b7be-fd9c262cf0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-495624740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921cf322-33a1-48d0-924f-4e22380d670f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d099029c5e4c17a585c824248f114f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:52Z,use_quota=True,user_id='b829850d1c914b139de475a3e15b19c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df3a5cf-d9f2-43df-a577-0f2f26735dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df3a5cf-d9f2-43df-a577-0f2f26735dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0712a6f1-c0b9-4842-afca-28749e1b2b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:51 devstack cinder-volume[86970]: DEBUG cinder.image.glance [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Creating Keystone auth plugin from conf {{(pid=86970) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:18:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0712a6f1-c0b9-4842-afca-28749e1b2b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '921cf322-33a1-48d0-924f-4e22380d670f', 'volume_name': 'volume-921cf322-33a1-48d0-924f-4e22380d670f', 'volume_size': 1, 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '280d624e0a3d44539d88968c5a0e8318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f44607-2972-4f83-83c4-59a73b638651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f44607-2972-4f83-83c4-59a73b638651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf9cc15-68da-4f0c-a838-7543a94e8289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:52 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Volume 921cf322-33a1-48d0-924f-4e22380d670f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-921cf322-33a1-48d0-924f-4e22380d670f', 'volume_size': 1, 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '280d624e0a3d44539d88968c5a0e8318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:18:52 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Trying to clone 921cf322-33a1-48d0-924f-4e22380d670f from image d659fbbf-f540-415a-bb1b-8ef207a29f4e at location (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]). {{(pid=86970) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:18:53 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_h7ppdydpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:18:53 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:18:54 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[6442863d-dcf7-4139-ad38-1c51a265f1fb]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_h7ppdydpdevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:54 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_h7ppdydpdevstack@QuobyteHD Sep 28 17:18:54 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:54 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_h7ppdydpdevstack@QuobyteHD" returned: 0 in 0.890s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:54 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Temporary image d659fbbf-f540-415a-bb1b-8ef207a29f4e is fetched for user b829850d1c914b139de475a3e15b19c1. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:18:55 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6678f3-8972-4a71-a0e0-027e2b7d008b]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_h7ppdydpdevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:55 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_h7ppdydpdevstack@QuobyteHD Sep 28 17:18:55 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:56 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_h7ppdydpdevstack@QuobyteHD" returned: 0 in 1.368s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:19:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:01 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:19:01 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:01 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c2be528-437d-4b42-99aa-64f4bd74e955" returned: 0 in 10.774s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:01 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Image conversion details: src /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206, size 1024.00 MB, duration 10.78 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c2be528-437d-4b42-99aa-64f4bd74e955 {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:19:01 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Converted 1024.00 MB image at 95.00 MB/s Sep 28 17:19:01 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c2be528-437d-4b42-99aa-64f4bd74e955 is being set with open permissions: ugo+rw Sep 28 17:19:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c2be528-437d-4b42-99aa-64f4bd74e955 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:01 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c2be528-437d-4b42-99aa-64f4bd74e955 Sep 28 17:19:01 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:01 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.771s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:19:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:19:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:19:02 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c2be528-437d-4b42-99aa-64f4bd74e955" returned: 0 in 0.346s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Lock "cinder-quobyte-9c2be528-437d-4b42-99aa-64f4bd74e955" released by "_copy_volume_from_snapshot" :: held 12.263s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Lock "cinder-quobyte-eba90339-12dd-46fb-ab6e-b36e444a31a8-9c2be528-437d-4b42-99aa-64f4bd74e955" released by "_create_volume_from_snapshot" :: held 12.363s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.402s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.635s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-495624740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921cf322-33a1-48d0-924f-4e22380d670f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d099029c5e4c17a585c824248f114f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:52Z,use_quota=True,user_id='b829850d1c914b139de475a3e15b19c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Creating volume 921cf322-33a1-48d0-924f-4e22380d670f {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:02 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:02 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f 1073741824 Sep 28 17:19:02 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25bf7ded-e3eb-4990-bf03-9c5ed7715e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c2be528-437d-4b42-99aa-64f4bd74e955', 'volume_size': 1, 'snapshot_id': 'eba90339-12dd-46fb-ab6e-b36e444a31a8'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a65adc-7eeb-4595-a375-24088291aff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:02 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Volume volume-9c2be528-437d-4b42-99aa-64f4bd74e955 (9c2be528-437d-4b42-99aa-64f4bd74e955): created successfully Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a65adc-7eeb-4595-a375-24088291aff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Flow 'volume_create_manager' (c132ea80-31aa-47dc-af05-4ab6bb07fe8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:02 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a2f69353-92d6-4a73-90e5-eac881fa6f37 tempest-TestStampPattern-1892120815 None] Created volume successfully. Sep 28 17:19:03 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f 1073741824" returned: 0 in 0.783s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:03 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f Sep 28 17:19:03 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:03 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f" returned: 0 in 0.527s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:03 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Attempting download of d659fbbf-f540-415a-bb1b-8ef207a29f4e ((None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}])) to volume 921cf322-33a1-48d0-924f-4e22380d670f. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:19:03 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5ce2bf-ac35-4bbb-89f9-38a82e40b330]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_y30wv3jn {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:03 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_y30wv3jn Sep 28 17:19:03 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:04 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_y30wv3jn" returned: 0 in 0.398s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_y30wv3jn {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:04 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_y30wv3jn Sep 28 17:19:04 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:04 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_y30wv3jn" returned: 1 in 0.429s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d659fbbf-f540-415a-bb1b-8ef207a29f4e_y30wv3jn' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:19:04 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66a3abd-fce6-44f5-bea4-b4624f5c99da]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_h7ppdydpdevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:04 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_h7ppdydpdevstack@QuobyteHD Sep 28 17:19:04 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:05 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_h7ppdydpdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:05 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] d659fbbf-f540-415a-bb1b-8ef207a29f4e was qcow2, converting to qcow2 {{(pid=86970) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:19:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_h7ppdydpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:05 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_h7ppdydpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f Sep 28 17:19:05 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:08 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_h7ppdydpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f" returned: 0 in 2.953s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:08 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d659fbbf-f540-415a-bb1b-8ef207a29f4e_h7ppdydpdevstack@QuobyteHD, size 112.00 MB, duration 2.95 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:19:08 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Converted 112.00 MB image at 37.91 MB/s Sep 28 17:19:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:08 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f 1G Sep 28 17:19:08 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:08 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f 1G" returned: 0 in 0.477s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:08 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Downloaded image d659fbbf-f540-415a-bb1b-8ef207a29f4e ((None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}])) to volume 921cf322-33a1-48d0-924f-4e22380d670f successfully. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:19:08 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Temporary image d659fbbf-f540-415a-bb1b-8ef207a29f4e for user b829850d1c914b139de475a3e15b19c1 is deleted. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:19:08 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Marking volume 921cf322-33a1-48d0-924f-4e22380d670f as bootable. {{(pid=86970) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:19:08 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Copying metadata from image d659fbbf-f540-415a-bb1b-8ef207a29f4e to 921cf322-33a1-48d0-924f-4e22380d670f. {{(pid=86970) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:19:08 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Creating volume glance metadata for volume 921cf322-33a1-48d0-924f-4e22380d670f backed by image d659fbbf-f540-415a-bb1b-8ef207a29f4e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86970) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:19:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf9cc15-68da-4f0c-a838-7543a94e8289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-921cf322-33a1-48d0-924f-4e22380d670f', 'volume_size': 1, 'image_id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '280d624e0a3d44539d88968c5a0e8318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd659fbbf-f540-415a-bb1b-8ef207a29f4e', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d659fbbf-f540-415a-bb1b-8ef207a29f4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11c1f4b-1d55-4496-b646-bb7209c4ed4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:08 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Volume volume-921cf322-33a1-48d0-924f-4e22380d670f (921cf322-33a1-48d0-924f-4e22380d670f): created successfully Sep 28 17:19:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11c1f4b-1d55-4496-b646-bb7209c4ed4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Flow 'volume_create_manager' (7b73b1fe-a848-4e74-ac68-e3ea2ac4d0ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:08 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-4e588572-5909-42f9-8882-c6b08a00563b tempest-TestShelveInstance-1287780072 None] Created volume successfully. Sep 28 17:19:14 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=64,cinder:UPDATE=33,cinder:INSERT=14,cinder:DELETE=2 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:19:14 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=48,cinder:UPDATE=42,cinder:INSERT=14,cinder:DELETE=4 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:19:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-0b45db02-85b1-4562-8188-fd6d165fe151 req-7a63ca0f-4c96-485a-a57b-91ec7f6777e5 tempest-TestShelveInstance-1287780072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-0b45db02-85b1-4562-8188-fd6d165fe151 req-7a63ca0f-4c96-485a-a57b-91ec7f6777e5 tempest-TestShelveInstance-1287780072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-0b45db02-85b1-4562-8188-fd6d165fe151 req-7a63ca0f-4c96-485a-a57b-91ec7f6777e5 tempest-TestShelveInstance-1287780072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-0b45db02-85b1-4562-8188-fd6d165fe151 req-7a63ca0f-4c96-485a-a57b-91ec7f6777e5 tempest-TestShelveInstance-1287780072 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-921cf322-33a1-48d0-924f-4e22380d670f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8888dcb4-9b55-4b57-a8fb-a83a49805ec2', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:19:14 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-0b45db02-85b1-4562-8188-fd6d165fe151 req-7a63ca0f-4c96-485a-a57b-91ec7f6777e5 tempest-TestShelveInstance-1287780072 None] attachment_update completed successfully. Sep 28 17:19:24 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:19:24 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Flow 'volume_create_manager' (a290c856-c42c-4854-8c5f-cbf811596587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fae2e1-c62f-4e93-848f-726197638127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fae2e1-c62f-4e93-848f-726197638127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1540417384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf3f8eb-497a-4ec1-8de5-7d7353791cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf5c9f1dd924192b01e63db12fb8f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:37Z,use_quota=True,user_id='fff67d27f8db48abbbbcf4461bd9aac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d580e2-4733-4596-a55f-b27d5af5cdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d580e2-4733-4596-a55f-b27d5af5cdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532388ed-4970-4fec-aff7-4eaece550054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532388ed-4970-4fec-aff7-4eaece550054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcf3f8eb-497a-4ec1-8de5-7d7353791cd3', 'volume_name': 'volume-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498270c5-b52e-43fd-a24b-16a4ef018029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498270c5-b52e-43fd-a24b-16a4ef018029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9608137-7265-4a70-b3bb-231d2eefcae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:37 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Volume bcf3f8eb-497a-4ec1-8de5-7d7353791cd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3', 'volume_size': 1} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1540417384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf3f8eb-497a-4ec1-8de5-7d7353791cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf5c9f1dd924192b01e63db12fb8f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:37Z,use_quota=True,user_id='fff67d27f8db48abbbbcf4461bd9aac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Creating volume bcf3f8eb-497a-4ec1-8de5-7d7353791cd3 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:37 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:37 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3 1073741824 Sep 28 17:19:37 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Flow 'volume_create_manager' (51a7ae4b-8f03-44d3-9714-7f4fdcea8719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70224667-301d-4f33-9b6f-8ac9159fab7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70224667-301d-4f33-9b6f-8ac9159fab7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-579251559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507cb917-4092-4e47-a91a-5cb2df27b798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf5c9f1dd924192b01e63db12fb8f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:38Z,use_quota=True,user_id='fff67d27f8db48abbbbcf4461bd9aac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977b8a9a-eef1-49c6-9665-30cebc280c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977b8a9a-eef1-49c6-9665-30cebc280c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f757d93-7020-48bd-8db3-5ce523f9ae9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f757d93-7020-48bd-8db3-5ce523f9ae9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '507cb917-4092-4e47-a91a-5cb2df27b798', 'volume_name': 'volume-507cb917-4092-4e47-a91a-5cb2df27b798', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d47eb6-b79f-4593-9d4d-733dec9722f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d47eb6-b79f-4593-9d4d-733dec9722f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d32591-4f5e-400f-9ec2-5828ae65e594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:37 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Volume 507cb917-4092-4e47-a91a-5cb2df27b798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-507cb917-4092-4e47-a91a-5cb2df27b798', 'volume_size': 1} Sep 28 17:19:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:38 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3 1073741824" returned: 0 in 0.648s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:38 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3 Sep 28 17:19:38 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:38 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3" returned: 0 in 0.358s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.439s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-579251559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507cb917-4092-4e47-a91a-5cb2df27b798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf5c9f1dd924192b01e63db12fb8f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:38Z,use_quota=True,user_id='fff67d27f8db48abbbbcf4461bd9aac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Creating volume 507cb917-4092-4e47-a91a-5cb2df27b798 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:38 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-507cb917-4092-4e47-a91a-5cb2df27b798 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9608137-7265-4a70-b3bb-231d2eefcae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7aee3e-59d4-4612-a926-b7ee4bb8e405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:38 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-507cb917-4092-4e47-a91a-5cb2df27b798 1073741824 Sep 28 17:19:38 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:38 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Volume volume-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3 (bcf3f8eb-497a-4ec1-8de5-7d7353791cd3): created successfully Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7aee3e-59d4-4612-a926-b7ee4bb8e405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Flow 'volume_create_manager' (a290c856-c42c-4854-8c5f-cbf811596587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:38 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-8a63bc38-e5c4-412d-b4c8-513f7c8ad9ba tempest-TestServerVolumeAttachmentScenario-1772278607 None] Created volume successfully. Sep 28 17:19:39 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-507cb917-4092-4e47-a91a-5cb2df27b798 1073741824" returned: 0 in 0.750s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-507cb917-4092-4e47-a91a-5cb2df27b798 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:39 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-507cb917-4092-4e47-a91a-5cb2df27b798 Sep 28 17:19:39 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:39 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-507cb917-4092-4e47-a91a-5cb2df27b798" returned: 0 in 0.294s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d32591-4f5e-400f-9ec2-5828ae65e594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-507cb917-4092-4e47-a91a-5cb2df27b798', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe22af8-5b60-4671-9b58-e9f717ae209b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:39 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Volume volume-507cb917-4092-4e47-a91a-5cb2df27b798 (507cb917-4092-4e47-a91a-5cb2df27b798): created successfully Sep 28 17:19:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe22af8-5b60-4671-9b58-e9f717ae209b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Flow 'volume_create_manager' (51a7ae4b-8f03-44d3-9714-7f4fdcea8719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:39 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-abf894c2-3119-410e-abd8-8419d3ed90c7 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Created volume successfully. Sep 28 17:19:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-0e7a67a5-7335-4fbf-9b20-39bd4a5ef358 req-db86389a-098f-43e1-a4cf-298686fee7ed tempest-TestStampPattern-1892120815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-0e7a67a5-7335-4fbf-9b20-39bd4a5ef358 req-db86389a-098f-43e1-a4cf-298686fee7ed tempest-TestStampPattern-1892120815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-0e7a67a5-7335-4fbf-9b20-39bd4a5ef358 req-db86389a-098f-43e1-a4cf-298686fee7ed tempest-TestStampPattern-1892120815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:47 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-0e7a67a5-7335-4fbf-9b20-39bd4a5ef358 req-db86389a-098f-43e1-a4cf-298686fee7ed tempest-TestStampPattern-1892120815 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-9c2be528-437d-4b42-99aa-64f4bd74e955', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92119cad-8a8d-418a-80bd-df18ef1bc771', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:19:47 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-0e7a67a5-7335-4fbf-9b20-39bd4a5ef358 req-db86389a-098f-43e1-a4cf-298686fee7ed tempest-TestStampPattern-1892120815 None] attachment_update completed successfully. Sep 28 17:19:51 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-5389d5c7-b45f-40df-99e3-88d9e191b09d req-3de0015f-b570-4706-b062-8f67a824fc16 tempest-TestStampPattern-1892120815 None] Terminate volume connection completed successfully. Sep 28 17:19:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-5389d5c7-b45f-40df-99e3-88d9e191b09d req-3de0015f-b570-4706-b062-8f67a824fc16 tempest-TestStampPattern-1892120815 None] Deleting attachment 92119cad-8a8d-418a-80bd-df18ef1bc771. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:19:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] Acquiring lock "cinder-9c2be528-437d-4b42-99aa-64f4bd74e955-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] Lock "cinder-9c2be528-437d-4b42-99aa-64f4bd74e955-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] Acquiring lock "cinder-quobyte-9c2be528-437d-4b42-99aa-64f4bd74e955" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] Lock "cinder-quobyte-9c2be528-437d-4b42-99aa-64f4bd74e955" acquired by "delete_volume" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:56 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9afc5a0-c011-4a78-8ff1-6c944b5e931e]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c2be528-437d-4b42-99aa-64f4bd74e955 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:56 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c2be528-437d-4b42-99aa-64f4bd74e955 Sep 28 17:19:56 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:57 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c2be528-437d-4b42-99aa-64f4bd74e955" returned: 0 in 0.400s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c2be528-437d-4b42-99aa-64f4bd74e955 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:57 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c2be528-437d-4b42-99aa-64f4bd74e955 Sep 28 17:19:57 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:57 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9c2be528-437d-4b42-99aa-64f4bd74e955" returned: 0 in 0.259s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] Lock "cinder-quobyte-9c2be528-437d-4b42-99aa-64f4bd74e955" released by "delete_volume" :: held 0.709s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:57 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] Created reservations ['e8fe1916-ea0a-4a27-95f2-1778ea78051b', '6bbd6e52-200c-4c08-95f7-34c2c2e30d4f', '392b4310-ce30-44fc-a0ca-9da8c6f91677', '0926148b-448b-445f-a4ed-cea09a7e3d25'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:57 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:19:57 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:57 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.328s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:57 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:57 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] Deleted volume successfully. Sep 28 17:19:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0e2fb327-4018-46d6-ba38-2799913f2b82 tempest-TestStampPattern-1892120815 None] Lock "cinder-9c2be528-437d-4b42-99aa-64f4bd74e955-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] Acquiring lock "cinder-eba90339-12dd-46fb-ab6e-b36e444a31a8-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] Lock "cinder-eba90339-12dd-46fb-ab6e-b36e444a31a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] Acquiring lock "cinder-quobyte-c68d84ca-2068-436d-9f06-e15358a47206" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] Lock "cinder-quobyte-c68d84ca-2068-436d-9f06-e15358a47206" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] Acquiring lock "cinder-quobyte-eba90339-12dd-46fb-ab6e-b36e444a31a8" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] Lock "cinder-quobyte-eba90339-12dd-46fb-ab6e-b36e444a31a8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] Deleting offline snapshot eba90339-12dd-46fb-ab6e-b36e444a31a8 of volume c68d84ca-2068-436d-9f06-e15358a47206 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:19:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] snapshot_file for this snap is: volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:19:58 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[549a7d7e-bc9c-4c53-8e7f-e9c354af5538]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:58 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8 Sep 28 17:19:58 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:58 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8" returned: 0 in 0.452s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c68d84ca-2068-436d-9f06-e15358a47206(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:19:58 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[85012d17-61cb-404c-ac99-a0869ce7f04c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:58 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 Sep 28 17:19:58 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:59 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206" returned: 0 in 0.576s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:59 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8 Sep 28 17:19:59 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:59 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8" returned: 0 in 0.343s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:59 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8 Sep 28 17:19:59 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:59 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206.eba90339-12dd-46fb-ab6e-b36e444a31a8" returned: 0 in 0.268s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:00 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] Lock "cinder-quobyte-eba90339-12dd-46fb-ab6e-b36e444a31a8" released by "_delete_snapshot" :: held 1.801s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:00 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] Lock "cinder-quobyte-c68d84ca-2068-436d-9f06-e15358a47206" released by "delete_snapshot" :: held 1.832s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:00 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] Created reservations ['585db480-036a-4edb-97c8-64a8fc2e764a', '92f16f44-9edb-405f-b277-bbe3e114aff7', 'f5008951-d15c-4b34-942f-f45c2f6d48c4', 'e9f80ff8-a9f1-4f4a-ac67-67370d4f7800'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:00 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] Delete snapshot completed successfully. Sep 28 17:20:00 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5fb9b8b1-1dca-4165-b75c-dc21b787a509 tempest-TestStampPattern-1892120815 None] Lock "cinder-eba90339-12dd-46fb-ab6e-b36e444a31a8-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:20:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:01 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:20:01 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:01 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.479s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:20:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:20:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:20:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] Acquiring lock "cinder-c68d84ca-2068-436d-9f06-e15358a47206-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] Lock "cinder-c68d84ca-2068-436d-9f06-e15358a47206-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] Acquiring lock "cinder-quobyte-c68d84ca-2068-436d-9f06-e15358a47206" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] Lock "cinder-quobyte-c68d84ca-2068-436d-9f06-e15358a47206" acquired by "delete_volume" :: waited 0.018s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:04 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe44c28-7d95-4656-934a-79906b889e4b]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:04 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 Sep 28 17:20:04 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:05 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206" returned: 0 in 0.402s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:05 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206 Sep 28 17:20:05 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:05 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-c68d84ca-2068-436d-9f06-e15358a47206" returned: 0 in 0.254s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] Lock "cinder-quobyte-c68d84ca-2068-436d-9f06-e15358a47206" released by "delete_volume" :: held 0.731s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:05 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] Created reservations ['2ea51e42-0009-44db-9d62-ed71ecd26d8e', '493af2ad-a263-474c-981c-deec629c2150', '9b369fe1-8ecc-4ee6-b031-a70ec07ef633', '360976d6-7982-4e6d-92eb-213cf3d79ff5'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:05 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:20:05 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:05 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.262s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:05 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:05 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] Deleted volume successfully. Sep 28 17:20:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bc547f97-3d8c-4ad8-b2b0-5ef67ecb988a tempest-TestStampPattern-1892120815 None] Lock "cinder-c68d84ca-2068-436d-9f06-e15358a47206-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:09 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-e76855d0-0ddf-48a1-bfa8-92e00423acd5 req-ee783f0a-369c-4c40-9ef2-434f237fa891 tempest-TestShelveInstance-1287780072 None] Terminate volume connection completed successfully. Sep 28 17:20:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-e76855d0-0ddf-48a1-bfa8-92e00423acd5 req-ee783f0a-369c-4c40-9ef2-434f237fa891 tempest-TestShelveInstance-1287780072 None] Deleting attachment 8888dcb4-9b55-4b57-a8fb-a83a49805ec2. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:20:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-b19611fa-6844-42da-97d4-4ddd6c464264 req-4c9afc08-d760-41e1-a313-c7b930b07e81 tempest-TestShelveInstance-1287780072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-b19611fa-6844-42da-97d4-4ddd6c464264 req-4c9afc08-d760-41e1-a313-c7b930b07e81 tempest-TestShelveInstance-1287780072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-b19611fa-6844-42da-97d4-4ddd6c464264 req-4c9afc08-d760-41e1-a313-c7b930b07e81 tempest-TestShelveInstance-1287780072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-b19611fa-6844-42da-97d4-4ddd6c464264 req-4c9afc08-d760-41e1-a313-c7b930b07e81 tempest-TestShelveInstance-1287780072 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-921cf322-33a1-48d0-924f-4e22380d670f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3bf628e5-2d22-4b46-baa0-6fafe4f0d73e', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:20:12 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-b19611fa-6844-42da-97d4-4ddd6c464264 req-4c9afc08-d760-41e1-a313-c7b930b07e81 tempest-TestShelveInstance-1287780072 None] attachment_update completed successfully. Sep 28 17:20:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-41c052c7-e764-455f-b810-8534cc5b4c2c req-a42deba5-fc76-4a90-b84f-51db76dc240b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-41c052c7-e764-455f-b810-8534cc5b4c2c req-a42deba5-fc76-4a90-b84f-51db76dc240b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-41c052c7-e764-455f-b810-8534cc5b4c2c req-a42deba5-fc76-4a90-b84f-51db76dc240b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:14 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-41c052c7-e764-455f-b810-8534cc5b4c2c req-a42deba5-fc76-4a90-b84f-51db76dc240b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b86f8f6e-19d4-4fb9-8ed3-fb222346a746', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:20:14 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-41c052c7-e764-455f-b810-8534cc5b4c2c req-a42deba5-fc76-4a90-b84f-51db76dc240b tempest-TestServerVolumeAttachmentScenario-1772278607 None] attachment_update completed successfully. Sep 28 17:20:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-0599a9f4-0791-4471-8718-d18b0954fea1 req-d0b058e1-493b-4943-9a6c-d4c90a288f8c tempest-TestServerVolumeAttachmentScenario-1772278607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-0599a9f4-0791-4471-8718-d18b0954fea1 req-d0b058e1-493b-4943-9a6c-d4c90a288f8c tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-0599a9f4-0791-4471-8718-d18b0954fea1 req-d0b058e1-493b-4943-9a6c-d4c90a288f8c tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-0599a9f4-0791-4471-8718-d18b0954fea1 req-d0b058e1-493b-4943-9a6c-d4c90a288f8c tempest-TestServerVolumeAttachmentScenario-1772278607 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973', 'name': 'volume-507cb917-4092-4e47-a91a-5cb2df27b798', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9801c032-3fac-4669-9b9b-51a1b5995ea3', 'enforce_multipath': True} {{(pid=86970) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:20:21 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-0599a9f4-0791-4471-8718-d18b0954fea1 req-d0b058e1-493b-4943-9a6c-d4c90a288f8c tempest-TestServerVolumeAttachmentScenario-1772278607 None] attachment_update completed successfully. Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Flow 'volume_create_manager' (8bdf58b5-6ffb-4fda-a078-67894059d67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de0ef58-0213-4f4e-98e3-9902be18dd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de0ef58-0213-4f4e-98e3-9902be18dd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1222298832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ca6cf0-2f21-404e-8fb9-57d486eebc65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ff1320283d448878bb592c794291973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:25Z,use_quota=True,user_id='10ddecbb66ce4e45980b3a11c0218e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45317a2d-1b33-4a55-a809-cd1ba4f72a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45317a2d-1b33-4a55-a809-cd1ba4f72a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cfadc1c-8e9a-4488-bf1a-6c09e1da740a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cfadc1c-8e9a-4488-bf1a-6c09e1da740a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60ca6cf0-2f21-404e-8fb9-57d486eebc65', 'volume_name': 'volume-60ca6cf0-2f21-404e-8fb9-57d486eebc65', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4c853a-8ced-4a9c-b5ab-7ff1af22ce60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4c853a-8ced-4a9c-b5ab-7ff1af22ce60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02815351-06c3-46e5-ab6b-6dba2c0f5170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:24 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Volume 60ca6cf0-2f21-404e-8fb9-57d486eebc65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60ca6cf0-2f21-404e-8fb9-57d486eebc65', 'volume_size': 1} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1222298832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ca6cf0-2f21-404e-8fb9-57d486eebc65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ff1320283d448878bb592c794291973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:25Z,use_quota=True,user_id='10ddecbb66ce4e45980b3a11c0218e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Creating volume 60ca6cf0-2f21-404e-8fb9-57d486eebc65 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:24 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60ca6cf0-2f21-404e-8fb9-57d486eebc65 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:24 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60ca6cf0-2f21-404e-8fb9-57d486eebc65 1073741824 Sep 28 17:20:24 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:24 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-376180cb-52b0-4489-baaf-a8cc62a39385 req-32f4f4b2-5f7e-400c-9c57-d37b5e1e0552 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Terminate volume connection completed successfully. Sep 28 17:20:24 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-376180cb-52b0-4489-baaf-a8cc62a39385 req-32f4f4b2-5f7e-400c-9c57-d37b5e1e0552 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Deleting attachment 9801c032-3fac-4669-9b9b-51a1b5995ea3. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:20:25 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60ca6cf0-2f21-404e-8fb9-57d486eebc65 1073741824" returned: 0 in 0.659s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60ca6cf0-2f21-404e-8fb9-57d486eebc65 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:25 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60ca6cf0-2f21-404e-8fb9-57d486eebc65 Sep 28 17:20:25 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:25 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60ca6cf0-2f21-404e-8fb9-57d486eebc65" returned: 0 in 0.427s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02815351-06c3-46e5-ab6b-6dba2c0f5170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60ca6cf0-2f21-404e-8fb9-57d486eebc65', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269b119b-4a4b-49f3-86db-435c0fa99524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:25 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Volume volume-60ca6cf0-2f21-404e-8fb9-57d486eebc65 (60ca6cf0-2f21-404e-8fb9-57d486eebc65): created successfully Sep 28 17:20:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269b119b-4a4b-49f3-86db-435c0fa99524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:25 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Flow 'volume_create_manager' (8bdf58b5-6ffb-4fda-a078-67894059d67c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:25 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-f2d0a420-43c1-4959-8f95-ab07afef9e2a tempest-ProjectReaderTests-1167395836 None] Created volume successfully. Sep 28 17:20:26 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-f06ea43c-7410-4894-beb5-68bab675b79e req-6ab39a05-24cd-4611-8e27-976181ab7acb tempest-TestServerVolumeAttachmentScenario-1772278607 None] Terminate volume connection completed successfully. Sep 28 17:20:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-f06ea43c-7410-4894-beb5-68bab675b79e req-6ab39a05-24cd-4611-8e27-976181ab7acb tempest-TestServerVolumeAttachmentScenario-1772278607 None] Deleting attachment b86f8f6e-19d4-4fb9-8ed3-fb222346a746. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:20:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] Acquiring lock "cinder-60ca6cf0-2f21-404e-8fb9-57d486eebc65-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] Lock "cinder-60ca6cf0-2f21-404e-8fb9-57d486eebc65-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] Acquiring lock "cinder-quobyte-60ca6cf0-2f21-404e-8fb9-57d486eebc65" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] Lock "cinder-quobyte-60ca6cf0-2f21-404e-8fb9-57d486eebc65" acquired by "delete_volume" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:27 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f6deb3-9364-4ff6-b00c-29c75c8e6add]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60ca6cf0-2f21-404e-8fb9-57d486eebc65 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:27 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60ca6cf0-2f21-404e-8fb9-57d486eebc65 Sep 28 17:20:27 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:27 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60ca6cf0-2f21-404e-8fb9-57d486eebc65" returned: 0 in 0.514s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60ca6cf0-2f21-404e-8fb9-57d486eebc65 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:27 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60ca6cf0-2f21-404e-8fb9-57d486eebc65 Sep 28 17:20:27 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:28 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60ca6cf0-2f21-404e-8fb9-57d486eebc65" returned: 0 in 0.617s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:28 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] Lock "cinder-quobyte-60ca6cf0-2f21-404e-8fb9-57d486eebc65" released by "delete_volume" :: held 1.216s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:28 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] Created reservations ['9749f83d-2b7f-4192-a0a8-a82184da75c0', 'c6a3d493-cdcf-4caa-bb39-a7add6fca3f3', '3f68281c-98f3-4c4f-9713-ced1210c8a30', '12d976f8-bf85-4139-89e2-1856516938c6'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:28 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:20:28 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:29 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.374s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:29 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:29 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] Deleted volume successfully. Sep 28 17:20:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-49401c75-7405-4659-8201-b0ec5ffb7d77 tempest-ProjectReaderTests-1167395836 None] Lock "cinder-60ca6cf0-2f21-404e-8fb9-57d486eebc65-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Flow 'volume_create_manager' (770b5d17-11f0-4eed-962e-45fe0773a4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafba944-5e3b-4507-85a4-f63bda0b43cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafba944-5e3b-4507-85a4-f63bda0b43cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1355358758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=700d7895-b6c9-47ec-beff-6564d0c93e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ff1320283d448878bb592c794291973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:30Z,use_quota=True,user_id='10ddecbb66ce4e45980b3a11c0218e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd96394-7d31-42c3-bac5-4fea4ad2ba58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd96394-7d31-42c3-bac5-4fea4ad2ba58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce96896-d5a3-492d-96ef-b528705a670f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce96896-d5a3-492d-96ef-b528705a670f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '700d7895-b6c9-47ec-beff-6564d0c93e03', 'volume_name': 'volume-700d7895-b6c9-47ec-beff-6564d0c93e03', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511951c6-9bec-43bd-9300-8e410733570f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511951c6-9bec-43bd-9300-8e410733570f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253e3e44-ef84-4756-8a24-89284befcb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:30 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Volume 700d7895-b6c9-47ec-beff-6564d0c93e03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-700d7895-b6c9-47ec-beff-6564d0c93e03', 'volume_size': 1} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1355358758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=700d7895-b6c9-47ec-beff-6564d0c93e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ff1320283d448878bb592c794291973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:30Z,use_quota=True,user_id='10ddecbb66ce4e45980b3a11c0218e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Creating volume 700d7895-b6c9-47ec-beff-6564d0c93e03 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:30 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:20:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-700d7895-b6c9-47ec-beff-6564d0c93e03 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:30 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-700d7895-b6c9-47ec-beff-6564d0c93e03 1073741824 Sep 28 17:20:30 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:31 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-700d7895-b6c9-47ec-beff-6564d0c93e03 1073741824" returned: 0 in 0.491s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-700d7895-b6c9-47ec-beff-6564d0c93e03 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:31 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-700d7895-b6c9-47ec-beff-6564d0c93e03 Sep 28 17:20:31 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:31 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-700d7895-b6c9-47ec-beff-6564d0c93e03" returned: 0 in 0.285s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253e3e44-ef84-4756-8a24-89284befcb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-700d7895-b6c9-47ec-beff-6564d0c93e03', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665ef15a-8e77-4bf3-97c0-fe3ef83b9464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:31 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Volume volume-700d7895-b6c9-47ec-beff-6564d0c93e03 (700d7895-b6c9-47ec-beff-6564d0c93e03): created successfully Sep 28 17:20:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665ef15a-8e77-4bf3-97c0-fe3ef83b9464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Flow 'volume_create_manager' (770b5d17-11f0-4eed-962e-45fe0773a4d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:31 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d76f90eb-a013-4212-b886-c6b305e32f31 tempest-ProjectReaderTests-1167395836 None] Created volume successfully. Sep 28 17:20:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] Acquiring lock "cinder-700d7895-b6c9-47ec-beff-6564d0c93e03-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] Lock "cinder-700d7895-b6c9-47ec-beff-6564d0c93e03-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] Acquiring lock "cinder-quobyte-700d7895-b6c9-47ec-beff-6564d0c93e03" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] Lock "cinder-quobyte-700d7895-b6c9-47ec-beff-6564d0c93e03" acquired by "delete_volume" :: waited 0.026s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Acquiring lock "cinder-507cb917-4092-4e47-a91a-5cb2df27b798-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "cinder-507cb917-4092-4e47-a91a-5cb2df27b798-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:32 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[545b5660-7387-42e3-b38b-3de457ac61fb]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-700d7895-b6c9-47ec-beff-6564d0c93e03 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Acquiring lock "cinder-quobyte-507cb917-4092-4e47-a91a-5cb2df27b798" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "cinder-quobyte-507cb917-4092-4e47-a91a-5cb2df27b798" acquired by "delete_volume" :: waited 0.022s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:32 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b38d21-1d9b-4262-8b57-52013b6e9886]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-507cb917-4092-4e47-a91a-5cb2df27b798 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:32 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-700d7895-b6c9-47ec-beff-6564d0c93e03 Sep 28 17:20:32 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:32 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-507cb917-4092-4e47-a91a-5cb2df27b798 Sep 28 17:20:32 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:33 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-700d7895-b6c9-47ec-beff-6564d0c93e03" returned: 0 in 0.419s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-700d7895-b6c9-47ec-beff-6564d0c93e03 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:33 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-700d7895-b6c9-47ec-beff-6564d0c93e03 Sep 28 17:20:33 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:33 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-507cb917-4092-4e47-a91a-5cb2df27b798" returned: 0 in 0.430s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-507cb917-4092-4e47-a91a-5cb2df27b798 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:33 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-507cb917-4092-4e47-a91a-5cb2df27b798 Sep 28 17:20:33 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:33 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-700d7895-b6c9-47ec-beff-6564d0c93e03" returned: 0 in 0.261s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] Lock "cinder-quobyte-700d7895-b6c9-47ec-beff-6564d0c93e03" released by "delete_volume" :: held 0.771s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] Created reservations ['e084623e-3eeb-4c41-9ae0-81b431bab767', '40d24aaf-8ff3-4b47-ad70-4c923fbe6d8b', 'b609f26e-9f33-49c0-91be-736c6de790bf', '2a4e4706-9f26-4b89-996e-5f22b29cc8cc'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:33 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-507cb917-4092-4e47-a91a-5cb2df27b798" returned: 0 in 0.274s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "cinder-quobyte-507cb917-4092-4e47-a91a-5cb2df27b798" released by "delete_volume" :: held 0.771s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Created reservations ['36402691-393f-49e9-a94a-93487774e949', '6d3a9b57-b3e8-4040-a8cb-b8f72afbe4b4', '251fe96d-97e1-4756-a4e4-5db74fa7a154', '540abd60-9819-4f7f-a71d-7b6183ac9175'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:33 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:20:33 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:33 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:20:33 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Acquiring lock "cinder-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:33 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.430s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:33 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "cinder-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:33 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] Deleted volume successfully. Sep 28 17:20:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-11df2b24-d7bb-43c3-9055-e7cbc14adbc9 tempest-ProjectReaderTests-1167395836 None] Lock "cinder-700d7895-b6c9-47ec-beff-6564d0c93e03-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Acquiring lock "cinder-quobyte-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "cinder-quobyte-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3" acquired by "delete_volume" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:34 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[93787e42-da12-4eda-b8d6-ca0100a1992a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:34 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.536s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:34 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:34 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Deleted volume successfully. Sep 28 17:20:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1134b9b2-c015-4a11-86b9-83ccd06834d5 tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "cinder-507cb917-4092-4e47-a91a-5cb2df27b798-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:34 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3 Sep 28 17:20:34 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:34 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3" returned: 0 in 0.472s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:34 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3 Sep 28 17:20:34 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:34 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3" returned: 0 in 0.280s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "cinder-quobyte-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3" released by "delete_volume" :: held 0.818s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:34 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=75,cinder:UPDATE=66,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:20:34 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:UPDATE=63,cinder:SELECT=67,cinder:INSERT=11,cinder:DELETE=5 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:20:35 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Created reservations ['8c860687-22f2-43d3-93f3-9292271c16b9', '51f743a0-e61e-4a17-ad65-850f568be6be', 'eb0626ee-d564-472c-b3ec-1d5a5b35a751', '7e7c25c2-f56f-4664-a257-83b74b463a1e'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:35 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:20:35 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:35 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.305s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:35 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:35 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Deleted volume successfully. Sep 28 17:20:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1ec63682-ee0b-475b-b1c6-4cc9551ad79b tempest-TestServerVolumeAttachmentScenario-1772278607 None] Lock "cinder-bcf3f8eb-497a-4ec1-8de5-7d7353791cd3-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:45 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=11 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:20:45 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Flow 'volume_create_manager' (9fde7d13-053a-49d4-8b08-5d8e2fddb493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f245b1f8-4018-4eb5-9f48-f42ade8b3ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f245b1f8-4018-4eb5-9f48-f42ade8b3ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-458807921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaec757a-96f0-4f0c-9172-7a83bb1ac6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e722d0af8c4305867526782cd4238a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:50Z,use_quota=True,user_id='2d9f6e74cda44074b8472891d9e220fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc854e36-e7b4-4e17-818e-d61d60ef87f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc854e36-e7b4-4e17-818e-d61d60ef87f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdc479d-d5cd-4ce2-943c-1176f1bf805d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdc479d-d5cd-4ce2-943c-1176f1bf805d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaec757a-96f0-4f0c-9172-7a83bb1ac6ab', 'volume_name': 'volume-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3111ea6d-bb2b-4d23-a573-d597bc8fe270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3111ea6d-bb2b-4d23-a573-d597bc8fe270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5936d0-ed68-4d75-a2c0-8b9d99111279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:50 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume aaec757a-96f0-4f0c-9172-7a83bb1ac6ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab', 'volume_size': 1} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-458807921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaec757a-96f0-4f0c-9172-7a83bb1ac6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e722d0af8c4305867526782cd4238a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:50Z,use_quota=True,user_id='2d9f6e74cda44074b8472891d9e220fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Creating volume aaec757a-96f0-4f0c-9172-7a83bb1ac6ab {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:50 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:50 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab 1073741824 Sep 28 17:20:50 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:50 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab 1073741824" returned: 0 in 0.501s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:50 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab Sep 28 17:20:50 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:51 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab" returned: 0 in 0.291s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5936d0-ed68-4d75-a2c0-8b9d99111279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbdc36ca-61be-4f6c-b642-d845eb2ceae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:51 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume volume-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab (aaec757a-96f0-4f0c-9172-7a83bb1ac6ab): created successfully Sep 28 17:20:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbdc36ca-61be-4f6c-b642-d845eb2ceae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Flow 'volume_create_manager' (9fde7d13-053a-49d4-8b08-5d8e2fddb493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:51 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-731d8acf-f618-417a-ae22-92244993b6d9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Created volume successfully. Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Flow 'volume_create_manager' (23c48b23-08bc-4504-93e3-195f0658afe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f698f16-edf5-4560-8590-e700a8c48e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f698f16-edf5-4560-8590-e700a8c48e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-217233316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f68fa12-01a2-40f7-9873-7aab3e998c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e722d0af8c4305867526782cd4238a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:53Z,use_quota=True,user_id='2d9f6e74cda44074b8472891d9e220fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442994c2-ee7c-4db6-a2c4-79a6e686083f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442994c2-ee7c-4db6-a2c4-79a6e686083f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5233a03-1584-4a69-95bf-186fc6688be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5233a03-1584-4a69-95bf-186fc6688be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f68fa12-01a2-40f7-9873-7aab3e998c08', 'volume_name': 'volume-8f68fa12-01a2-40f7-9873-7aab3e998c08', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be093376-eaf0-4616-976d-8a42dd207539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be093376-eaf0-4616-976d-8a42dd207539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987469d4-60c3-4acc-a554-9649f2203ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:52 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume 8f68fa12-01a2-40f7-9873-7aab3e998c08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f68fa12-01a2-40f7-9873-7aab3e998c08', 'volume_size': 1} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-217233316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f68fa12-01a2-40f7-9873-7aab3e998c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e722d0af8c4305867526782cd4238a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:53Z,use_quota=True,user_id='2d9f6e74cda44074b8472891d9e220fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Creating volume 8f68fa12-01a2-40f7-9873-7aab3e998c08 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:52 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:20:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8f68fa12-01a2-40f7-9873-7aab3e998c08 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:52 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8f68fa12-01a2-40f7-9873-7aab3e998c08 1073741824 Sep 28 17:20:52 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Flow 'volume_create_manager' (ed11f4fb-4808-453a-b68b-8dad482afc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999cf95c-fda4-4b9f-88c0-ee58d88e6e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999cf95c-fda4-4b9f-88c0-ee58d88e6e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-698086911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e722d0af8c4305867526782cd4238a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:53Z,use_quota=True,user_id='2d9f6e74cda44074b8472891d9e220fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984d7f1f-34f9-4ba2-960e-730602a130fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984d7f1f-34f9-4ba2-960e-730602a130fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a59f2a-6a0e-45da-aa79-d348fee987a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a59f2a-6a0e-45da-aa79-d348fee987a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1ab035d-440d-4b4e-87b4-51a2f1c6f6fc', 'volume_name': 'volume-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3832c8e-fe26-473f-a6cf-54831668a1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3832c8e-fe26-473f-a6cf-54831668a1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629ddfbd-d3fd-4a15-8b66-e151d0ddf9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc', 'volume_size': 1} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:53 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8f68fa12-01a2-40f7-9873-7aab3e998c08 1073741824" returned: 0 in 0.533s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8f68fa12-01a2-40f7-9873-7aab3e998c08 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:53 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8f68fa12-01a2-40f7-9873-7aab3e998c08 Sep 28 17:20:53 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Flow 'volume_create_manager' (bfb25599-7299-4fa7-a0c2-0046af22cac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814c993e-792f-45ce-81f9-440708eb67ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814c993e-792f-45ce-81f9-440708eb67ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-496484234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bce133-ccd9-407b-a723-9b5d421c1922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e722d0af8c4305867526782cd4238a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:54Z,use_quota=True,user_id='2d9f6e74cda44074b8472891d9e220fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d656cd-fb8a-418e-b63d-9d6ca6a98b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d656cd-fb8a-418e-b63d-9d6ca6a98b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de18755-4c4d-4607-9e83-ab7438f1178e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de18755-4c4d-4607-9e83-ab7438f1178e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35bce133-ccd9-407b-a723-9b5d421c1922', 'volume_name': 'volume-35bce133-ccd9-407b-a723-9b5d421c1922', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008471c6-94f2-4865-a6a9-33e78ecb06b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008471c6-94f2-4865-a6a9-33e78ecb06b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0207e6a-0a56-4d5e-859b-6a3bec363b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume 35bce133-ccd9-407b-a723-9b5d421c1922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35bce133-ccd9-407b-a723-9b5d421c1922', 'volume_size': 1} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:53 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8f68fa12-01a2-40f7-9873-7aab3e998c08" returned: 0 in 0.259s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.469s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-698086911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e722d0af8c4305867526782cd4238a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:53Z,use_quota=True,user_id='2d9f6e74cda44074b8472891d9e220fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Creating volume d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:53 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987469d4-60c3-4acc-a554-9649f2203ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f68fa12-01a2-40f7-9873-7aab3e998c08', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1326795-00c6-456e-927a-341576d2455a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc 1073741824 Sep 28 17:20:53 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:53 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume volume-8f68fa12-01a2-40f7-9873-7aab3e998c08 (8f68fa12-01a2-40f7-9873-7aab3e998c08): created successfully Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1326795-00c6-456e-927a-341576d2455a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Flow 'volume_create_manager' (23c48b23-08bc-4504-93e3-195f0658afe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:53 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-551f6d74-b482-49bc-b3ce-39e884bd0fe9 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Created volume successfully. Sep 28 17:20:53 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Flow 'volume_create_manager' (fb599ac3-d5f2-4219-baab-a79f2c231ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2de2df-1db9-448e-91c8-6436412c97ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2de2df-1db9-448e-91c8-6436412c97ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2038556079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c5d988-4da3-4998-a729-31aa3090906a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e722d0af8c4305867526782cd4238a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:54Z,use_quota=True,user_id='2d9f6e74cda44074b8472891d9e220fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f07402-ae88-4e7c-ac8b-2f5405454561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f07402-ae88-4e7c-ac8b-2f5405454561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0d5f6d-839a-49d4-8d59-a5c61b145287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0d5f6d-839a-49d4-8d59-a5c61b145287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85c5d988-4da3-4998-a729-31aa3090906a', 'volume_name': 'volume-85c5d988-4da3-4998-a729-31aa3090906a', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6493e7-92af-4df0-82b1-ce2fe6bac894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6493e7-92af-4df0-82b1-ce2fe6bac894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffbace7-b5a4-43ca-891a-2d1b81d2b3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume 85c5d988-4da3-4998-a729-31aa3090906a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85c5d988-4da3-4998-a729-31aa3090906a', 'volume_size': 1} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:54 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc 1073741824" returned: 0 in 0.596s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:54 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc Sep 28 17:20:54 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Flow 'volume_create_manager' (9fc33417-eb76-483a-8a70-34d5ff81aaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cef92c6-9cbd-4b1c-aeca-01a0f5b82b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cef92c6-9cbd-4b1c-aeca-01a0f5b82b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1983644700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6deb3fdf-9346-416f-8434-82cc1c4083b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e722d0af8c4305867526782cd4238a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:54Z,use_quota=True,user_id='2d9f6e74cda44074b8472891d9e220fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4804a06-6c6e-4179-a313-fe5a47e39034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4804a06-6c6e-4179-a313-fe5a47e39034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ad3df9-b9e5-44d0-a867-d83e2eb01e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ad3df9-b9e5-44d0-a867-d83e2eb01e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6deb3fdf-9346-416f-8434-82cc1c4083b2', 'volume_name': 'volume-6deb3fdf-9346-416f-8434-82cc1c4083b2', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a915c6-7c8f-4135-8652-1de0ba188518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a915c6-7c8f-4135-8652-1de0ba188518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7a7894-55f1-403e-ab65-6cbb58e2771a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume 6deb3fdf-9346-416f-8434-82cc1c4083b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6deb3fdf-9346-416f-8434-82cc1c4083b2', 'volume_size': 1} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:54 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc" returned: 0 in 0.305s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.998s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-496484234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bce133-ccd9-407b-a723-9b5d421c1922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e722d0af8c4305867526782cd4238a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:54Z,use_quota=True,user_id='2d9f6e74cda44074b8472891d9e220fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Creating volume 35bce133-ccd9-407b-a723-9b5d421c1922 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:54 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35bce133-ccd9-407b-a723-9b5d421c1922 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629ddfbd-d3fd-4a15-8b66-e151d0ddf9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd37d9cf-01f9-4d1d-a6fa-2c1240baaa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35bce133-ccd9-407b-a723-9b5d421c1922 1073741824 Sep 28 17:20:54 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:54 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume volume-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc (d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc): created successfully Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd37d9cf-01f9-4d1d-a6fa-2c1240baaa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Flow 'volume_create_manager' (ed11f4fb-4808-453a-b68b-8dad482afc94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:54 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ed77cdc5-1387-471e-8440-4e163deb17c2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Created volume successfully. Sep 28 17:20:55 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35bce133-ccd9-407b-a723-9b5d421c1922 1073741824" returned: 0 in 0.466s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35bce133-ccd9-407b-a723-9b5d421c1922 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:55 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35bce133-ccd9-407b-a723-9b5d421c1922 Sep 28 17:20:55 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:55 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35bce133-ccd9-407b-a723-9b5d421c1922" returned: 0 in 0.264s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.359s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2038556079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c5d988-4da3-4998-a729-31aa3090906a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e722d0af8c4305867526782cd4238a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:54Z,use_quota=True,user_id='2d9f6e74cda44074b8472891d9e220fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Creating volume 85c5d988-4da3-4998-a729-31aa3090906a {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:55 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-85c5d988-4da3-4998-a729-31aa3090906a 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0207e6a-0a56-4d5e-859b-6a3bec363b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35bce133-ccd9-407b-a723-9b5d421c1922', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:55 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-85c5d988-4da3-4998-a729-31aa3090906a 1073741824 Sep 28 17:20:55 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619768cd-0c91-43e9-9cec-ad1e35b33e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:55 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume volume-35bce133-ccd9-407b-a723-9b5d421c1922 (35bce133-ccd9-407b-a723-9b5d421c1922): created successfully Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619768cd-0c91-43e9-9cec-ad1e35b33e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Flow 'volume_create_manager' (bfb25599-7299-4fa7-a0c2-0046af22cac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:55 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-7ee17079-7824-4db9-911a-691626e36caf tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Created volume successfully. Sep 28 17:20:55 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-85c5d988-4da3-4998-a729-31aa3090906a 1073741824" returned: 0 in 0.445s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-85c5d988-4da3-4998-a729-31aa3090906a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:55 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-85c5d988-4da3-4998-a729-31aa3090906a Sep 28 17:20:55 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:56 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-85c5d988-4da3-4998-a729-31aa3090906a" returned: 0 in 0.274s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.686s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1983644700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6deb3fdf-9346-416f-8434-82cc1c4083b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e722d0af8c4305867526782cd4238a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:54Z,use_quota=True,user_id='2d9f6e74cda44074b8472891d9e220fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Creating volume 6deb3fdf-9346-416f-8434-82cc1c4083b2 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:56 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6deb3fdf-9346-416f-8434-82cc1c4083b2 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffbace7-b5a4-43ca-891a-2d1b81d2b3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85c5d988-4da3-4998-a729-31aa3090906a', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:56 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6deb3fdf-9346-416f-8434-82cc1c4083b2 1073741824 Sep 28 17:20:56 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08907951-7198-4432-9fbc-63689625bc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:56 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume volume-85c5d988-4da3-4998-a729-31aa3090906a (85c5d988-4da3-4998-a729-31aa3090906a): created successfully Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08907951-7198-4432-9fbc-63689625bc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Flow 'volume_create_manager' (fb599ac3-d5f2-4219-baab-a79f2c231ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:56 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d9cb38bb-0d94-4a79-80ab-6beb288b27f2 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Created volume successfully. Sep 28 17:20:56 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6deb3fdf-9346-416f-8434-82cc1c4083b2 1073741824" returned: 0 in 0.508s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6deb3fdf-9346-416f-8434-82cc1c4083b2 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:56 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6deb3fdf-9346-416f-8434-82cc1c4083b2 Sep 28 17:20:56 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:57 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6deb3fdf-9346-416f-8434-82cc1c4083b2" returned: 0 in 0.286s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7a7894-55f1-403e-ab65-6cbb58e2771a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6deb3fdf-9346-416f-8434-82cc1c4083b2', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9404bf0b-ef79-4742-af15-0ea169d11ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:57 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Volume volume-6deb3fdf-9346-416f-8434-82cc1c4083b2 (6deb3fdf-9346-416f-8434-82cc1c4083b2): created successfully Sep 28 17:20:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9404bf0b-ef79-4742-af15-0ea169d11ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Flow 'volume_create_manager' (9fc33417-eb76-483a-8a70-34d5ff81aaad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:57 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-884f9872-4856-41e3-928c-911407c02261 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Created volume successfully. Sep 28 17:20:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "cinder-6deb3fdf-9346-416f-8434-82cc1c4083b2-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-6deb3fdf-9346-416f-8434-82cc1c4083b2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "cinder-quobyte-6deb3fdf-9346-416f-8434-82cc1c4083b2" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-quobyte-6deb3fdf-9346-416f-8434-82cc1c4083b2" acquired by "delete_volume" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:58 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf91889-33b5-4db8-8c9c-8c4383d85c34]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6deb3fdf-9346-416f-8434-82cc1c4083b2 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:58 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6deb3fdf-9346-416f-8434-82cc1c4083b2 Sep 28 17:20:58 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:58 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6deb3fdf-9346-416f-8434-82cc1c4083b2" returned: 0 in 0.416s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6deb3fdf-9346-416f-8434-82cc1c4083b2 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:58 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6deb3fdf-9346-416f-8434-82cc1c4083b2 Sep 28 17:20:58 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:58 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6deb3fdf-9346-416f-8434-82cc1c4083b2" returned: 0 in 0.409s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-quobyte-6deb3fdf-9346-416f-8434-82cc1c4083b2" released by "delete_volume" :: held 0.892s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:58 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Created reservations ['550a8969-363f-424b-83e1-d85bb2ece2e7', 'fe85b0ae-62f2-46af-a576-619fc34449f8', '1a331d65-e194-4089-b063-70cfb10cc871', '15d89fb4-0457-4de2-8eef-674053049d4d'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:59 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:20:59 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:59 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "cinder-85c5d988-4da3-4998-a729-31aa3090906a-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:59 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-85c5d988-4da3-4998-a729-31aa3090906a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:59 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "cinder-quobyte-85c5d988-4da3-4998-a729-31aa3090906a" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:59 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-quobyte-85c5d988-4da3-4998-a729-31aa3090906a" acquired by "delete_volume" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:59 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fe7b17-ccc1-4a0f-bed0-340d3c0e6890]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-85c5d988-4da3-4998-a729-31aa3090906a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:59 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.440s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:59 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:59 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Deleted volume successfully. Sep 28 17:20:59 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-33bc04b6-9b0e-4242-9b5b-24e5f3a6f528 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-6deb3fdf-9346-416f-8434-82cc1c4083b2-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:59 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-85c5d988-4da3-4998-a729-31aa3090906a Sep 28 17:20:59 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:00 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-85c5d988-4da3-4998-a729-31aa3090906a" returned: 0 in 0.720s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-85c5d988-4da3-4998-a729-31aa3090906a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:00 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-85c5d988-4da3-4998-a729-31aa3090906a Sep 28 17:21:00 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:00 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-85c5d988-4da3-4998-a729-31aa3090906a" returned: 0 in 0.365s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:00 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-quobyte-85c5d988-4da3-4998-a729-31aa3090906a" released by "delete_volume" :: held 1.177s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:00 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Created reservations ['44b3bb08-6770-4572-9a3b-c6a8256ad94f', '91ee485b-44b4-4eb6-bde4-318346cd8ec3', 'f68a4340-93db-47eb-bd45-b9d42878af3d', 'ae8ddfe5-2ff8-4ece-b05b-a6afa160efa5'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:00 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:21:00 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:01 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.378s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:01 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Deleted volume successfully. Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-047cf640-a826-4af8-87eb-7b03fff98694 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-85c5d988-4da3-4998-a729-31aa3090906a-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:01 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:21:01 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:01 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-7d94fef2-2e76-46bd-86bd-ba8c148a17e6 tempest-TestShelveInstance-1287780072 None] Terminate volume connection completed successfully. Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-7d94fef2-2e76-46bd-86bd-ba8c148a17e6 tempest-TestShelveInstance-1287780072 None] Deleting attachment 3bf628e5-2d22-4b46-baa0-6fafe4f0d73e. {{(pid=86970) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] Acquiring lock "cinder-921cf322-33a1-48d0-924f-4e22380d670f-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:01 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.313s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] Lock "cinder-921cf322-33a1-48d0-924f-4e22380d670f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] Acquiring lock "cinder-quobyte-921cf322-33a1-48d0-924f-4e22380d670f" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] Lock "cinder-quobyte-921cf322-33a1-48d0-924f-4e22380d670f" acquired by "delete_volume" :: waited 0.026s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba6f6f5-af1a-4097-91f8-e0df90d210df]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "cinder-35bce133-ccd9-407b-a723-9b5d421c1922-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-35bce133-ccd9-407b-a723-9b5d421c1922-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:01 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f Sep 28 17:21:01 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "cinder-quobyte-35bce133-ccd9-407b-a723-9b5d421c1922" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-quobyte-35bce133-ccd9-407b-a723-9b5d421c1922" acquired by "delete_volume" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[befee9b9-f259-457b-9593-944d18dfbcbe]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35bce133-ccd9-407b-a723-9b5d421c1922 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:02 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35bce133-ccd9-407b-a723-9b5d421c1922 Sep 28 17:21:02 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:02 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f" returned: 0 in 0.500s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:02 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f Sep 28 17:21:02 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:02 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35bce133-ccd9-407b-a723-9b5d421c1922" returned: 0 in 0.559s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35bce133-ccd9-407b-a723-9b5d421c1922 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:02 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35bce133-ccd9-407b-a723-9b5d421c1922 Sep 28 17:21:02 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:02 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-921cf322-33a1-48d0-924f-4e22380d670f" returned: 0 in 0.345s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] Lock "cinder-quobyte-921cf322-33a1-48d0-924f-4e22380d670f" released by "delete_volume" :: held 0.932s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG cinder.quota [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] Created reservations ['4ffc3035-d19a-4ef8-b785-610bb52eb628', '46328605-9d30-4679-8b00-092e12fbd43c', 'bc921d83-7b0b-4e32-b20b-54c61b02737c', '3cda3a37-331e-4b8a-9616-41c1d4387509'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:02 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:21:02 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:02 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-35bce133-ccd9-407b-a723-9b5d421c1922" returned: 0 in 0.367s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-quobyte-35bce133-ccd9-407b-a723-9b5d421c1922" released by "delete_volume" :: held 0.987s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Created reservations ['de99a446-73ee-49a0-b3af-117c33fe73fc', '48789d07-33df-47c1-a482-6821706dd6f4', 'a1a12acf-c92e-4f4a-8631-a241bbf37284', 'a628a73a-657c-4b11-a9b8-cca8a16b2801'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:03 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.312s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:03 devstack cinder-volume[86970]: DEBUG cinder.manager [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:03 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:21:03 devstack cinder-volume[86970]: INFO cinder.volume.manager [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] Deleted volume successfully. Sep 28 17:21:03 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [req-cc30dff9-afad-4022-bd09-5d5811f77852 req-0e7810fe-b48c-4fde-9e96-5764bd5e9871 tempest-TestShelveInstance-1287780072 None] Lock "cinder-921cf322-33a1-48d0-924f-4e22380d670f-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:03 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.394s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:03 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:03 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Deleted volume successfully. Sep 28 17:21:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-81985274-2479-45d1-bcdd-3c4f60eec85f tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-35bce133-ccd9-407b-a723-9b5d421c1922-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "cinder-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "cinder-quobyte-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-quobyte-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc" acquired by "delete_volume" :: waited 0.015s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:04 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd29ef6-2bd1-4784-aa88-c29a577c2cec]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:04 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc Sep 28 17:21:04 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:04 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc" returned: 0 in 0.447s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:04 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc Sep 28 17:21:04 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:04 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc" returned: 0 in 0.305s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-quobyte-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc" released by "delete_volume" :: held 0.811s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:04 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Created reservations ['a688ab73-f00f-4cbd-bb43-6d033f519341', '45a5df6f-4686-45fd-a48d-cd4a0afc8a90', '43bbe1a8-5335-460b-b148-c9836eacad74', '76898328-c2f1-45de-92c6-437f145613b4'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:05 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:21:05 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "cinder-8f68fa12-01a2-40f7-9873-7aab3e998c08-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-8f68fa12-01a2-40f7-9873-7aab3e998c08-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "cinder-quobyte-8f68fa12-01a2-40f7-9873-7aab3e998c08" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-quobyte-8f68fa12-01a2-40f7-9873-7aab3e998c08" acquired by "delete_volume" :: waited 0.018s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:05 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.340s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:05 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:05 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad449d02-2003-4353-aa0d-8fc5a7a55d32]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8f68fa12-01a2-40f7-9873-7aab3e998c08 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:05 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Deleted volume successfully. Sep 28 17:21:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-34eb522d-8e22-489e-a49c-be23fb5e5159 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-d1ab035d-440d-4b4e-87b4-51a2f1c6f6fc-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:05 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8f68fa12-01a2-40f7-9873-7aab3e998c08 Sep 28 17:21:05 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:05 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8f68fa12-01a2-40f7-9873-7aab3e998c08" returned: 0 in 0.433s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8f68fa12-01a2-40f7-9873-7aab3e998c08 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:05 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8f68fa12-01a2-40f7-9873-7aab3e998c08 Sep 28 17:21:05 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:06 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8f68fa12-01a2-40f7-9873-7aab3e998c08" returned: 0 in 0.285s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-quobyte-8f68fa12-01a2-40f7-9873-7aab3e998c08" released by "delete_volume" :: held 0.791s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Created reservations ['98e0b693-19c3-445c-b99d-1bde2007c8f4', '481c5f2b-36f5-488e-a204-c23b34ab36ab', '428a1eac-521d-4dec-b590-1fd33a8c8c50', '2081fe80-60e4-413b-9caa-bf400b262f77'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:06 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:21:06 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "cinder-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "cinder-quobyte-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-quobyte-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab" acquired by "delete_volume" :: waited 0.016s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1a3009-3f67-43fc-8cc6-edbf79d8a9eb]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:06 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.336s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:06 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Deleted volume successfully. Sep 28 17:21:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e5ca7428-f530-4d4b-a62d-b94a6145bd65 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-8f68fa12-01a2-40f7-9873-7aab3e998c08-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:06 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab Sep 28 17:21:06 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:07 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab" returned: 0 in 0.528s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:07 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab Sep 28 17:21:07 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:07 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab" returned: 0 in 0.286s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-quobyte-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab" released by "delete_volume" :: held 0.878s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:07 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Created reservations ['16cb2ee8-2646-41d3-9fd0-63b501c49f35', '71c359ac-c055-461b-a4ae-0e8d45e8709f', '02ee25e6-c072-4fef-b573-304e2c402062', 'c72c0982-926c-4632-9bc3-6a2e0a72571a'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:07 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:21:07 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:07 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.324s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:07 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:07 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Deleted volume successfully. Sep 28 17:21:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-34a33cf4-ccda-4b40-b7c0-ca1df2e86517 tempest-CreateVolumesFromSourceVolumeTest-805178193 None] Lock "cinder-aaec757a-96f0-4f0c-9172-7a83bb1ac6ab-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:17 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=45,cinder:INSERT=20,cinder:UPDATE=72,cinder:DELETE=5 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:21:17 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:UPDATE=76,cinder:SELECT=51,cinder:DELETE=8,cinder:INSERT=14 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:21:23 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Flow 'volume_create_manager' (c8d78c29-d78d-4579-bcb0-c54a09463e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3217329c-5b75-4469-8f83-a90325f1f870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3217329c-5b75-4469-8f83-a90325f1f870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0b0179-45dc-4e87-a820-d75f71f31980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868ce7621d764452b89a52c8c90e3373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:23Z,use_quota=True,user_id='3830d4ac57024094a6e95a1f55f08f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d705525d-fdc7-4720-83ca-f15cc2f3b3ad),volume_type_id=d705525d-fdc7-4720-83ca-f15cc2f3b3ad)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac12eab-535d-4767-b4e7-5915204b9695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac12eab-535d-4767-b4e7-5915204b9695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37cc3539-4dec-4f96-96e5-660ae5a0b470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:23 devstack cinder-volume[86970]: DEBUG cinder.image.glance [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Creating Keystone auth plugin from conf {{(pid=86970) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:21:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37cc3539-4dec-4f96-96e5-660ae5a0b470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2f0b0179-45dc-4e87-a820-d75f71f31980', 'volume_name': 'volume-2f0b0179-45dc-4e87-a820-d75f71f31980', 'volume_size': 1, 'image_id': '811eaa67-44ae-4b33-a95b-2b56254a0ae3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/811eaa67-44ae-4b33-a95b-2b56254a0ae3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63b442d1e0f72db7b61048ee12652497', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '868ce7621d764452b89a52c8c90e3373', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a1157c2cd5bd6b25d8facaefc21bb94b1e95684213660949afab1f4909f3dc1a8f9f82daa9b698149b262be7a380725776baf51b6edca3eb094e006567aabe49', 'id': '811eaa67-44ae-4b33-a95b-2b56254a0ae3', 'created_at': datetime.datetime(2026, 9, 28, 15, 21, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 21, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/811eaa67-44ae-4b33-a95b-2b56254a0ae3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f7f2ce-a33f-49d4-bb8c-571b6a83ac0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f7f2ce-a33f-49d4-bb8c-571b6a83ac0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7941cff-b475-4113-b44d-43953b41a338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:23 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Volume 2f0b0179-45dc-4e87-a820-d75f71f31980: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2f0b0179-45dc-4e87-a820-d75f71f31980', 'volume_size': 1, 'image_id': '811eaa67-44ae-4b33-a95b-2b56254a0ae3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/811eaa67-44ae-4b33-a95b-2b56254a0ae3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63b442d1e0f72db7b61048ee12652497', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '868ce7621d764452b89a52c8c90e3373', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a1157c2cd5bd6b25d8facaefc21bb94b1e95684213660949afab1f4909f3dc1a8f9f82daa9b698149b262be7a380725776baf51b6edca3eb094e006567aabe49', 'id': '811eaa67-44ae-4b33-a95b-2b56254a0ae3', 'created_at': datetime.datetime(2026, 9, 28, 15, 21, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 21, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/811eaa67-44ae-4b33-a95b-2b56254a0ae3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 17:21:23 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Trying to clone 2f0b0179-45dc-4e87-a820-d75f71f31980 from image 811eaa67-44ae-4b33-a95b-2b56254a0ae3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/811eaa67-44ae-4b33-a95b-2b56254a0ae3', 'metadata': {}}]). {{(pid=86970) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:21:23 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:21:23 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:21:24 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8351ed-8036-4354-8251-c287ad7fc98c]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:24 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD Sep 28 17:21:24 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:24 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:24 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD Sep 28 17:21:24 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:24 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD" returned: 1 in 0.413s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:21:24 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Temporary image 811eaa67-44ae-4b33-a95b-2b56254a0ae3 is fetched for user 3830d4ac57024094a6e95a1f55f08f5d. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:21:24 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8fde7a-8861-4300-b853-6dfc32c27df4]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:25 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD Sep 28 17:21:25 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:25 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD" returned: 0 in 0.385s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:25 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD Sep 28 17:21:25 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:25 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD" returned: 1 in 0.388s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:21:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0b0179-45dc-4e87-a820-d75f71f31980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868ce7621d764452b89a52c8c90e3373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:23Z,use_quota=True,user_id='3830d4ac57024094a6e95a1f55f08f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d705525d-fdc7-4720-83ca-f15cc2f3b3ad),volume_type_id=d705525d-fdc7-4720-83ca-f15cc2f3b3ad)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Creating volume 2f0b0179-45dc-4e87-a820-d75f71f31980 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:25 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:25 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:21:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:25 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980 1073741824 Sep 28 17:21:25 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:26 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980 1073741824" returned: 0 in 0.563s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:26 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980 Sep 28 17:21:26 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:26 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980" returned: 0 in 0.335s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:26 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Attempting download of 811eaa67-44ae-4b33-a95b-2b56254a0ae3 ((None, [{'url': 'file:///opt/stack/data/glance/images/811eaa67-44ae-4b33-a95b-2b56254a0ae3', 'metadata': {}}])) to volume 2f0b0179-45dc-4e87-a820-d75f71f31980. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:21:26 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e9a18e-038b-4f17-9e04-9df505ca0b75]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_811eaa67-44ae-4b33-a95b-2b56254a0ae3_7c9vbne_ {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:26 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_811eaa67-44ae-4b33-a95b-2b56254a0ae3_7c9vbne_ Sep 28 17:21:26 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:27 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_811eaa67-44ae-4b33-a95b-2b56254a0ae3_7c9vbne_" returned: 0 in 0.398s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_811eaa67-44ae-4b33-a95b-2b56254a0ae3_7c9vbne_ {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:27 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_811eaa67-44ae-4b33-a95b-2b56254a0ae3_7c9vbne_ Sep 28 17:21:27 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:27 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_811eaa67-44ae-4b33-a95b-2b56254a0ae3_7c9vbne_" returned: 1 in 0.397s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_811eaa67-44ae-4b33-a95b-2b56254a0ae3_7c9vbne_' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:21:27 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[58297fde-f452-4bd3-863f-77fe550a5958]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:27 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD Sep 28 17:21:27 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:27 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD" returned: 0 in 0.405s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:28 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD Sep 28 17:21:28 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:28 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD" returned: 1 in 0.433s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:21:28 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] 811eaa67-44ae-4b33-a95b-2b56254a0ae3 was raw, converting to qcow2 {{(pid=86970) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:21:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:28 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980 Sep 28 17:21:28 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:29 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980" returned: 0 in 0.658s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:29 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_811eaa67-44ae-4b33-a95b-2b56254a0ae3_ojndsfx0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980 {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:21:29 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:21:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:29 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980 1G Sep 28 17:21:29 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:29 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980 1G" returned: 0 in 0.485s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:29 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Downloaded image 811eaa67-44ae-4b33-a95b-2b56254a0ae3 ((None, [{'url': 'file:///opt/stack/data/glance/images/811eaa67-44ae-4b33-a95b-2b56254a0ae3', 'metadata': {}}])) to volume 2f0b0179-45dc-4e87-a820-d75f71f31980 successfully. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:21:29 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Temporary image 811eaa67-44ae-4b33-a95b-2b56254a0ae3 for user 3830d4ac57024094a6e95a1f55f08f5d is deleted. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:21:29 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Marking volume 2f0b0179-45dc-4e87-a820-d75f71f31980 as bootable. {{(pid=86970) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:21:29 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Copying metadata from image 811eaa67-44ae-4b33-a95b-2b56254a0ae3 to 2f0b0179-45dc-4e87-a820-d75f71f31980. {{(pid=86970) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:21:29 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Creating volume glance metadata for volume 2f0b0179-45dc-4e87-a820-d75f71f31980 backed by image 811eaa67-44ae-4b33-a95b-2b56254a0ae3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '811eaa67-44ae-4b33-a95b-2b56254a0ae3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '63b442d1e0f72db7b61048ee12652497', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86970) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:21:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7941cff-b475-4113-b44d-43953b41a338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0b0179-45dc-4e87-a820-d75f71f31980', 'volume_size': 1, 'image_id': '811eaa67-44ae-4b33-a95b-2b56254a0ae3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/811eaa67-44ae-4b33-a95b-2b56254a0ae3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63b442d1e0f72db7b61048ee12652497', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '868ce7621d764452b89a52c8c90e3373', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a1157c2cd5bd6b25d8facaefc21bb94b1e95684213660949afab1f4909f3dc1a8f9f82daa9b698149b262be7a380725776baf51b6edca3eb094e006567aabe49', 'id': '811eaa67-44ae-4b33-a95b-2b56254a0ae3', 'created_at': datetime.datetime(2026, 9, 28, 15, 21, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 21, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/811eaa67-44ae-4b33-a95b-2b56254a0ae3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a48fa9a-a694-4079-84d6-b32b71b82f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:29 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Volume volume-2f0b0179-45dc-4e87-a820-d75f71f31980 (2f0b0179-45dc-4e87-a820-d75f71f31980): created successfully Sep 28 17:21:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a48fa9a-a694-4079-84d6-b32b71b82f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Flow 'volume_create_manager' (c8d78c29-d78d-4579-bcb0-c54a09463e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:29 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0521b351-982e-4079-850d-0949d1425824 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Created volume successfully. Sep 28 17:21:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Acquiring lock "cinder-2f0b0179-45dc-4e87-a820-d75f71f31980-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Lock "cinder-2f0b0179-45dc-4e87-a820-d75f71f31980-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Acquiring lock "cinder-quobyte-2f0b0179-45dc-4e87-a820-d75f71f31980" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Lock "cinder-quobyte-2f0b0179-45dc-4e87-a820-d75f71f31980" acquired by "delete_volume" :: waited 0.022s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:30 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[92309776-fecb-459d-b0fa-f378509f92c2]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:30 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980 Sep 28 17:21:30 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:30 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980" returned: 0 in 0.433s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:30 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980 Sep 28 17:21:30 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:30 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2f0b0179-45dc-4e87-a820-d75f71f31980" returned: 0 in 0.294s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Lock "cinder-quobyte-2f0b0179-45dc-4e87-a820-d75f71f31980" released by "delete_volume" :: held 0.789s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:30 devstack cinder-volume[86970]: WARNING cinder.quota [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:21:30 devstack cinder-volume[86970]: WARNING cinder.quota [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:21:30 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Created reservations ['a9959290-2b11-41b8-9700-9c5b3dbba565', '3190bce8-4e87-466b-a102-63ebb295109f', '1d6f77e4-a007-45d5-8e0e-324837bf06b7', 'e0868536-9947-4770-b191-44d987eeee00'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:31 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:21:31 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:31 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.425s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:31 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:31 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Deleted volume successfully. Sep 28 17:21:31 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0cad6203-28aa-4d39-a528-b439209bf1a0 tempest-VolumeAndVolumeTypeFromImageTest-1937651078 None] Lock "cinder-2f0b0179-45dc-4e87-a820-d75f71f31980-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:40 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Flow 'volume_create_manager' (92e3781e-d989-42c2-908e-304458995f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70a14d9-198f-490a-9979-360ba6eeb97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70a14d9-198f-490a-9979-360ba6eeb97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8b6856-ba31-4a82-ba40-cbaa5769655b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972340b5885e40ec8f96ba20b15135af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:40Z,use_quota=True,user_id='2087d8f75fd64592863b36a346653eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9bcb4e-1b5e-4186-a20d-0ef175c506db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9bcb4e-1b5e-4186-a20d-0ef175c506db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2a0603-4e85-4982-b40e-a85b466c7349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:40 devstack cinder-volume[86970]: DEBUG cinder.image.glance [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Creating Keystone auth plugin from conf {{(pid=86970) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:21:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2a0603-4e85-4982-b40e-a85b466c7349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae8b6856-ba31-4a82-ba40-cbaa5769655b', 'volume_name': 'volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b', 'volume_size': 1, 'image_id': 'ea227439-39b1-44eb-abf7-6830839f3466', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea227439-39b1-44eb-abf7-6830839f3466', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f158d22abf3861bf6f52e6eb3a423d06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '972340b5885e40ec8f96ba20b15135af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '937104861bbda9f8037a356c492bf2e3a3ae1ebae8ac9c67aefe05cfbfa71e343fcddfbcfa7c07c9fbbe12fe8054c8408efc0e1c706c079c72f0264961a1ed75', 'id': 'ea227439-39b1-44eb-abf7-6830839f3466', 'created_at': datetime.datetime(2026, 9, 28, 15, 21, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 21, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea227439-39b1-44eb-abf7-6830839f3466/file', 'properties': {}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97cf333-73b6-4321-8a2b-18da248f011f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97cf333-73b6-4321-8a2b-18da248f011f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e0d5fe-04ac-4e15-a122-51405dae9372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:40 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Volume ae8b6856-ba31-4a82-ba40-cbaa5769655b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b', 'volume_size': 1, 'image_id': 'ea227439-39b1-44eb-abf7-6830839f3466', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea227439-39b1-44eb-abf7-6830839f3466', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f158d22abf3861bf6f52e6eb3a423d06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '972340b5885e40ec8f96ba20b15135af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '937104861bbda9f8037a356c492bf2e3a3ae1ebae8ac9c67aefe05cfbfa71e343fcddfbcfa7c07c9fbbe12fe8054c8408efc0e1c706c079c72f0264961a1ed75', 'id': 'ea227439-39b1-44eb-abf7-6830839f3466', 'created_at': datetime.datetime(2026, 9, 28, 15, 21, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 21, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea227439-39b1-44eb-abf7-6830839f3466/file', 'properties': {}}, 'image_service': } Sep 28 17:21:40 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Trying to clone ae8b6856-ba31-4a82-ba40-cbaa5769655b from image ea227439-39b1-44eb-abf7-6830839f3466 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ea227439-39b1-44eb-abf7-6830839f3466', 'metadata': {}}]). {{(pid=86970) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:21:40 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:21:40 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:21:40 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e1a1da-b4f4-43ce-8582-74b64f678e5b]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:40 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD Sep 28 17:21:40 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:41 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:41 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD Sep 28 17:21:41 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:41 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD" returned: 1 in 0.410s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:21:41 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Temporary image ea227439-39b1-44eb-abf7-6830839f3466 is fetched for user 2087d8f75fd64592863b36a346653eb9. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:21:41 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[14079613-807d-4786-9702-9884af8c8358]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:41 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD Sep 28 17:21:41 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:41 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:42 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD Sep 28 17:21:42 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:42 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD" returned: 1 in 0.400s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8b6856-ba31-4a82-ba40-cbaa5769655b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972340b5885e40ec8f96ba20b15135af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:40Z,use_quota=True,user_id='2087d8f75fd64592863b36a346653eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Creating volume ae8b6856-ba31-4a82-ba40-cbaa5769655b {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:42 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:42 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b 1073741824 Sep 28 17:21:42 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:42 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b 1073741824" returned: 0 in 0.501s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:42 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b Sep 28 17:21:42 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Flow 'volume_create_manager' (9b1e5dc2-0f1f-4e63-9c8f-0b20948b195a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57791bf-0848-4853-b495-24e129659254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57791bf-0848-4853-b495-24e129659254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1856060802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8958fb13-bb40-421c-a292-31fe47e30c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94dcc789a3ce4f02ab5af68b96f0c3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:43Z,use_quota=True,user_id='1e74679593bb41fabdf6c642b28684cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67d486a-8a2d-407b-829b-5d1a72d201e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67d486a-8a2d-407b-829b-5d1a72d201e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb9717e-b600-4ebf-9878-c3057df184d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb9717e-b600-4ebf-9878-c3057df184d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8958fb13-bb40-421c-a292-31fe47e30c03', 'volume_name': 'volume-8958fb13-bb40-421c-a292-31fe47e30c03', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60571e50-ef9a-4834-b06d-d7891a6c97dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60571e50-ef9a-4834-b06d-d7891a6c97dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4bbe96-abae-4576-a747-f3b5b063dccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:42 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Volume 8958fb13-bb40-421c-a292-31fe47e30c03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8958fb13-bb40-421c-a292-31fe47e30c03', 'volume_size': 1} Sep 28 17:21:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:43 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b" returned: 0 in 0.280s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.137s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1856060802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8958fb13-bb40-421c-a292-31fe47e30c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94dcc789a3ce4f02ab5af68b96f0c3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:43Z,use_quota=True,user_id='1e74679593bb41fabdf6c642b28684cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Creating volume 8958fb13-bb40-421c-a292-31fe47e30c03 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:43 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:43 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 1073741824 Sep 28 17:21:43 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Attempting download of ea227439-39b1-44eb-abf7-6830839f3466 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea227439-39b1-44eb-abf7-6830839f3466', 'metadata': {}}])) to volume ae8b6856-ba31-4a82-ba40-cbaa5769655b. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f0b492-daef-4c1a-bb78-b563ade58dfe]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea227439-39b1-44eb-abf7-6830839f3466_d54l1gi2 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:43 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea227439-39b1-44eb-abf7-6830839f3466_d54l1gi2 Sep 28 17:21:43 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:43 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 1073741824" returned: 0 in 0.480s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:43 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea227439-39b1-44eb-abf7-6830839f3466_d54l1gi2" returned: 0 in 0.439s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea227439-39b1-44eb-abf7-6830839f3466_d54l1gi2 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:43 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 Sep 28 17:21:43 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:43 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea227439-39b1-44eb-abf7-6830839f3466_d54l1gi2 Sep 28 17:21:43 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:43 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03" returned: 0 in 0.268s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4bbe96-abae-4576-a747-f3b5b063dccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8958fb13-bb40-421c-a292-31fe47e30c03', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b502f59-f1e8-42df-b3c4-3a0ff01803ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:43 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Volume volume-8958fb13-bb40-421c-a292-31fe47e30c03 (8958fb13-bb40-421c-a292-31fe47e30c03): created successfully Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b502f59-f1e8-42df-b3c4-3a0ff01803ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:43 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Flow 'volume_create_manager' (9b1e5dc2-0f1f-4e63-9c8f-0b20948b195a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:43 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-e0e52c1f-99d1-47af-953a-b83c5ba088f9 tempest-SnapshotDependencyTests-1380882697 None] Created volume successfully. Sep 28 17:21:44 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea227439-39b1-44eb-abf7-6830839f3466_d54l1gi2" returned: 1 in 0.367s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea227439-39b1-44eb-abf7-6830839f3466_d54l1gi2' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:21:44 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2b7df4-8ab5-4122-8879-168ad9934ec4]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:44 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD Sep 28 17:21:44 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:44 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:44 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD Sep 28 17:21:44 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:44 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:21:44 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] ea227439-39b1-44eb-abf7-6830839f3466 was raw, converting to qcow2 {{(pid=86970) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:21:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:44 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b Sep 28 17:21:44 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:45 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b" returned: 0 in 0.591s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ea227439-39b1-44eb-abf7-6830839f3466_0o2uuv4ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:21:45 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:45 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b 1G Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:45 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] Creating offline snapshot 280e6615-4c54-47c9-9b06-b28eb0035e2c of volume 8958fb13-bb40-421c-a292-31fe47e30c03 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[968cf7bd-57db-4d98-8f7d-92cbd5a5b59f]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:45 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 Sep 28 17:21:45 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:45 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b 1G" returned: 0 in 0.394s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Downloaded image ea227439-39b1-44eb-abf7-6830839f3466 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea227439-39b1-44eb-abf7-6830839f3466', 'metadata': {}}])) to volume ae8b6856-ba31-4a82-ba40-cbaa5769655b successfully. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Temporary image ea227439-39b1-44eb-abf7-6830839f3466 for user 2087d8f75fd64592863b36a346653eb9 is deleted. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Marking volume ae8b6856-ba31-4a82-ba40-cbaa5769655b as bootable. {{(pid=86970) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Copying metadata from image ea227439-39b1-44eb-abf7-6830839f3466 to ae8b6856-ba31-4a82-ba40-cbaa5769655b. {{(pid=86970) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Creating volume glance metadata for volume ae8b6856-ba31-4a82-ba40-cbaa5769655b backed by image ea227439-39b1-44eb-abf7-6830839f3466 with: {'image_id': 'ea227439-39b1-44eb-abf7-6830839f3466', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f158d22abf3861bf6f52e6eb3a423d06', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86970) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e0d5fe-04ac-4e15-a122-51405dae9372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b', 'volume_size': 1, 'image_id': 'ea227439-39b1-44eb-abf7-6830839f3466', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea227439-39b1-44eb-abf7-6830839f3466', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f158d22abf3861bf6f52e6eb3a423d06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '972340b5885e40ec8f96ba20b15135af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '937104861bbda9f8037a356c492bf2e3a3ae1ebae8ac9c67aefe05cfbfa71e343fcddfbcfa7c07c9fbbe12fe8054c8408efc0e1c706c079c72f0264961a1ed75', 'id': 'ea227439-39b1-44eb-abf7-6830839f3466', 'created_at': datetime.datetime(2026, 9, 28, 15, 21, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 21, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea227439-39b1-44eb-abf7-6830839f3466/file', 'properties': {}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02eab1d0-e0c7-41c9-9f0d-d742e2f114a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:45 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Volume volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b (ae8b6856-ba31-4a82-ba40-cbaa5769655b): created successfully Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02eab1d0-e0c7-41c9-9f0d-d742e2f114a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Flow 'volume_create_manager' (92e3781e-d989-42c2-908e-304458995f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:45 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03" returned: 0 in 0.443s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:45 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2ac4bc29-b986-4163-a993-570c839bd9f8 tempest-VolumeImageDependencyTests-236570179 None] Created volume successfully. Sep 28 17:21:45 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c 1G Sep 28 17:21:45 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:46 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c 1G" returned: 0 in 0.435s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8958fb13-bb40-421c-a292-31fe47e30c03 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:46 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8958fb13-bb40-421c-a292-31fe47e30c03 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c Sep 28 17:21:46 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:46 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8958fb13-bb40-421c-a292-31fe47e30c03 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c" returned: 0 in 0.345s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:46 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c is being set with open permissions: ugo+rw Sep 28 17:21:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] Acquiring lock "cinder-ae8b6856-ba31-4a82-ba40-cbaa5769655b-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:46 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c Sep 28 17:21:46 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] Lock "cinder-ae8b6856-ba31-4a82-ba40-cbaa5769655b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] Acquiring lock "cinder-quobyte-ae8b6856-ba31-4a82-ba40-cbaa5769655b" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] Lock "cinder-quobyte-ae8b6856-ba31-4a82-ba40-cbaa5769655b" acquired by "delete_volume" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:46 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1544508-7105-4aa8-845e-e350acfc357c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:46 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b Sep 28 17:21:46 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:46 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c" returned: 0 in 0.312s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:47 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.info Sep 28 17:21:47 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:47 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b" returned: 0 in 0.437s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:47 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b Sep 28 17:21:47 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:47 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.info" returned: 0 in 0.316s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:47 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.info is being set with open permissions: ugo+rw Sep 28 17:21:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:47 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.info Sep 28 17:21:47 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:47 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ae8b6856-ba31-4a82-ba40-cbaa5769655b" returned: 0 in 0.300s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] Lock "cinder-quobyte-ae8b6856-ba31-4a82-ba40-cbaa5769655b" released by "delete_volume" :: held 0.804s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:47 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] Created reservations ['1536f73e-5444-4dca-8520-6e23ddcee195', '9299764b-5fa7-4786-b95c-78670d472cba', '7e08f2ee-b1d5-4264-a03e-dc741628c83f', 'ed217e23-0d2d-46d5-aa10-34d3d7c2ea48'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:47 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.info" returned: 0 in 0.383s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.356s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:47 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-84ca68bd-8cc0-407b-8e39-f1147d2123c2 tempest-SnapshotDependencyTests-1380882697 None] Create snapshot completed successfully Sep 28 17:21:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:47 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:47 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:47 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:21:47 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:48 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.323s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:48 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:48 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] Deleted volume successfully. Sep 28 17:21:48 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-69beacd8-cb1b-47ca-8b23-09557e83b147 tempest-VolumeImageDependencyTests-236570179 None] Lock "cinder-ae8b6856-ba31-4a82-ba40-cbaa5769655b-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Flow 'volume_create_manager' (9455fb4a-e725-44d8-bae5-6576fac83380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59c0061-882e-4f7a-aa08-58d9430ff8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59c0061-882e-4f7a-aa08-58d9430ff8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e770d29-825c-4e5f-a6bb-6cdea38bf10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94dcc789a3ce4f02ab5af68b96f0c3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=280e6615-4c54-47c9-9b06-b28eb0035e2c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:49Z,use_quota=True,user_id='1e74679593bb41fabdf6c642b28684cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fb3151-2e5f-4e30-ba62-2ff3293e6734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fb3151-2e5f-4e30-ba62-2ff3293e6734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35584e01-b06d-4231-9b22-c36c7b2029aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35584e01-b06d-4231-9b22-c36c7b2029aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1e770d29-825c-4e5f-a6bb-6cdea38bf10a', 'volume_name': 'volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a', 'volume_size': 1, 'snapshot_id': '280e6615-4c54-47c9-9b06-b28eb0035e2c'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb33afa-c4e1-4970-adf7-40f0a7cd56d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb33afa-c4e1-4970-adf7-40f0a7cd56d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18a1eab-9d01-4677-a449-b3213cbe2921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:49 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Volume 1e770d29-825c-4e5f-a6bb-6cdea38bf10a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a', 'volume_size': 1, 'snapshot_id': '280e6615-4c54-47c9-9b06-b28eb0035e2c'} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Acquiring lock "cinder-quobyte-280e6615-4c54-47c9-9b06-b28eb0035e2c-1e770d29-825c-4e5f-a6bb-6cdea38bf10a" by "_create_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-quobyte-280e6615-4c54-47c9-9b06-b28eb0035e2c-1e770d29-825c-4e5f-a6bb-6cdea38bf10a" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Creating volume 1e770d29-825c-4e5f-a6bb-6cdea38bf10a from snapshot 280e6615-4c54-47c9-9b06-b28eb0035e2c {{(pid=86970) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Acquiring lock "cinder-quobyte-1e770d29-825c-4e5f-a6bb-6cdea38bf10a" by "_copy_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-quobyte-1e770d29-825c-4e5f-a6bb-6cdea38bf10a" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] snapshot: 280e6615-4c54-47c9-9b06-b28eb0035e2c, volume: 1e770d29-825c-4e5f-a6bb-6cdea38bf10a, {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4eca11-8c62-43c8-b317-1d633e598df5]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:49 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c Sep 28 17:21:49 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:50 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c" returned: 0 in 0.540s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8958fb13-bb40-421c-a292-31fe47e30c03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:21:50 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[0693be1a-d601-44fd-9a6e-92f1776bfa81]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:50 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 Sep 28 17:21:50 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:50 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03" returned: 0 in 0.469s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:21:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Creating direct copy from snapshot {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:21:50 devstack cinder-volume[86970]: DEBUG cinder.utils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Path /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a not found in is_blk_device check {{(pid=86970) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:21:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:50 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a Sep 28 17:21:50 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:52 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Flow 'volume_create_manager' (faff0c0c-e63c-49b9-a3dd-60122dde4cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb759aa7-39e9-4e3c-8a0c-d2e76e501cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb759aa7-39e9-4e3c-8a0c-d2e76e501cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a756bcdc-68d4-4a8e-9475-d83736ff1dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8301424791554ec2854fde43eebab239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:52Z,use_quota=True,user_id='72657c623f4c4ea485946acf9b85fc6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb98da00-9087-4d39-b5a6-ad13cdc4fbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb98da00-9087-4d39-b5a6-ad13cdc4fbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb474048-38d9-4464-972e-2f9c086bec7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb474048-38d9-4464-972e-2f9c086bec7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a756bcdc-68d4-4a8e-9475-d83736ff1dbc', 'volume_name': 'volume-a756bcdc-68d4-4a8e-9475-d83736ff1dbc', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00328fe9-fc77-4d12-8b7f-e23ea6d047a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00328fe9-fc77-4d12-8b7f-e23ea6d047a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0d3160-8b7c-4148-98f6-32714dfd8ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:52 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Volume a756bcdc-68d4-4a8e-9475-d83736ff1dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a756bcdc-68d4-4a8e-9475-d83736ff1dbc', 'volume_size': 1} Sep 28 17:21:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:57 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a" returned: 0 in 6.516s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Image conversion details: src /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:21:57 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Converted 1024.00 MB image at 157.13 MB/s Sep 28 17:21:57 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a is being set with open permissions: ugo+rw Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:57 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a Sep 28 17:21:57 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:57 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a" returned: 0 in 0.252s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-quobyte-1e770d29-825c-4e5f-a6bb-6cdea38bf10a" released by "_copy_volume_from_snapshot" :: held 7.894s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-quobyte-280e6615-4c54-47c9-9b06-b28eb0035e2c-1e770d29-825c-4e5f-a6bb-6cdea38bf10a" released by "_create_volume_from_snapshot" :: held 7.974s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.999s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.738s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a756bcdc-68d4-4a8e-9475-d83736ff1dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8301424791554ec2854fde43eebab239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:52Z,use_quota=True,user_id='72657c623f4c4ea485946acf9b85fc6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Creating volume a756bcdc-68d4-4a8e-9475-d83736ff1dbc {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:57 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a756bcdc-68d4-4a8e-9475-d83736ff1dbc 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:57 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a756bcdc-68d4-4a8e-9475-d83736ff1dbc 1073741824 Sep 28 17:21:57 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18a1eab-9d01-4677-a449-b3213cbe2921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a', 'volume_size': 1, 'snapshot_id': '280e6615-4c54-47c9-9b06-b28eb0035e2c'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2adc43-5724-454d-aa4d-80707e8b0da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:57 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Volume volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a (1e770d29-825c-4e5f-a6bb-6cdea38bf10a): created successfully Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2adc43-5724-454d-aa4d-80707e8b0da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Flow 'volume_create_manager' (9455fb4a-e725-44d8-bae5-6576fac83380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:57 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2e371226-51fe-4eb9-a154-6673072bf0e5 tempest-SnapshotDependencyTests-1380882697 None] Created volume successfully. Sep 28 17:21:57 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a756bcdc-68d4-4a8e-9475-d83736ff1dbc 1073741824" returned: 0 in 0.489s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a756bcdc-68d4-4a8e-9475-d83736ff1dbc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:58 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a756bcdc-68d4-4a8e-9475-d83736ff1dbc Sep 28 17:21:58 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:58 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a756bcdc-68d4-4a8e-9475-d83736ff1dbc" returned: 0 in 0.276s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0d3160-8b7c-4148-98f6-32714dfd8ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a756bcdc-68d4-4a8e-9475-d83736ff1dbc', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b3ab1e-d0bd-481b-96ae-8b1adf704628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] Acquiring lock "cinder-280e6615-4c54-47c9-9b06-b28eb0035e2c-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:58 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Volume volume-a756bcdc-68d4-4a8e-9475-d83736ff1dbc (a756bcdc-68d4-4a8e-9475-d83736ff1dbc): created successfully Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b3ab1e-d0bd-481b-96ae-8b1adf704628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Flow 'volume_create_manager' (faff0c0c-e63c-49b9-a3dd-60122dde4cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-280e6615-4c54-47c9-9b06-b28eb0035e2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] Acquiring lock "cinder-quobyte-8958fb13-bb40-421c-a292-31fe47e30c03" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:58 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-85bfdecb-84a7-4ceb-8924-c655832f72e6 tempest-CinderUnicodeTest-1991244623 None] Created volume successfully. Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-quobyte-8958fb13-bb40-421c-a292-31fe47e30c03" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] Acquiring lock "cinder-quobyte-280e6615-4c54-47c9-9b06-b28eb0035e2c" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-quobyte-280e6615-4c54-47c9-9b06-b28eb0035e2c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] Deleting offline snapshot 280e6615-4c54-47c9-9b06-b28eb0035e2c of volume 8958fb13-bb40-421c-a292-31fe47e30c03 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] snapshot_file for this snap is: volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e05240-74fa-4b77-86b4-2987b6b564a6]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:58 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c Sep 28 17:21:58 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:58 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c" returned: 0 in 0.416s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8958fb13-bb40-421c-a292-31fe47e30c03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f0f464-7fba-44b4-9a26-4ca90f01699b]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:59 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 Sep 28 17:21:59 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:59 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03" returned: 0 in 0.647s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:59 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c Sep 28 17:21:59 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Flow 'volume_create_manager' (62695954-41e7-45d8-a7d2-3483b674bb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc23844-81be-47f4-b387-fed772b75291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc23844-81be-47f4-b387-fed772b75291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1232447759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91ab8d2-53ee-431e-b70b-bb6595c37739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8301424791554ec2854fde43eebab239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:00Z,use_quota=True,user_id='72657c623f4c4ea485946acf9b85fc6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07c29e6-116c-49e8-b1ef-21f0aebc976c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07c29e6-116c-49e8-b1ef-21f0aebc976c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c08b594-93ab-4e23-90d2-712b49d11bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c08b594-93ab-4e23-90d2-712b49d11bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a91ab8d2-53ee-431e-b70b-bb6595c37739', 'volume_name': 'volume-a91ab8d2-53ee-431e-b70b-bb6595c37739', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431e3f91-2175-4d65-a901-5eab4dd3c53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431e3f91-2175-4d65-a901-5eab4dd3c53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890daba8-7a12-43a2-b484-26a9ca0ba255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:59 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Volume a91ab8d2-53ee-431e-b70b-bb6595c37739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a91ab8d2-53ee-431e-b70b-bb6595c37739', 'volume_size': 1} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1232447759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91ab8d2-53ee-431e-b70b-bb6595c37739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8301424791554ec2854fde43eebab239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:00Z,use_quota=True,user_id='72657c623f4c4ea485946acf9b85fc6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Creating volume a91ab8d2-53ee-431e-b70b-bb6595c37739 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:59 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:59 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739 1073741824 Sep 28 17:21:59 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:59 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c" returned: 0 in 0.415s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:00 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c Sep 28 17:22:00 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:00 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:00 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739 1073741824" returned: 0 in 0.534s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03.280e6615-4c54-47c9-9b06-b28eb0035e2c" returned: 0 in 0.328s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:00 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-quobyte-280e6615-4c54-47c9-9b06-b28eb0035e2c" released by "_delete_snapshot" :: held 1.953s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:00 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-quobyte-8958fb13-bb40-421c-a292-31fe47e30c03" released by "delete_snapshot" :: held 1.987s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:00 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739 Sep 28 17:22:00 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:00 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] Created reservations ['fc8130c2-a31b-497c-ab30-792631a75d15', '0019fed0-1629-4d97-ac81-14944fdd1cbb', 'e0455c8c-9729-43d0-9acb-515923bbfd8b', '77a8beec-dea4-4ea3-bc68-24c816bc8aa6'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:00 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] Delete snapshot completed successfully. Sep 28 17:22:00 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a409b6e5-7d10-40b5-b193-350e7ca76964 tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-280e6615-4c54-47c9-9b06-b28eb0035e2c-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:00 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739" returned: 0 in 0.282s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890daba8-7a12-43a2-b484-26a9ca0ba255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a91ab8d2-53ee-431e-b70b-bb6595c37739', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3343a6e-c253-4cc6-ba24-011aa936f148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:00 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Volume volume-a91ab8d2-53ee-431e-b70b-bb6595c37739 (a91ab8d2-53ee-431e-b70b-bb6595c37739): created successfully Sep 28 17:22:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3343a6e-c253-4cc6-ba24-011aa936f148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Flow 'volume_create_manager' (62695954-41e7-45d8-a7d2-3483b674bb7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:00 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d9756ba3-d8b4-480d-8c68-ab86f44816c8 tempest-CinderUnicodeTest-1991244623 None] Created volume successfully. Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:01 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:22:01 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:01 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.276s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] Acquiring lock "cinder-8958fb13-bb40-421c-a292-31fe47e30c03-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-8958fb13-bb40-421c-a292-31fe47e30c03-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] Acquiring lock "cinder-quobyte-8958fb13-bb40-421c-a292-31fe47e30c03" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-quobyte-8958fb13-bb40-421c-a292-31fe47e30c03" acquired by "delete_volume" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[042bf339-0b9b-49fb-97a5-04c91e514269]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:01 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 Sep 28 17:22:01 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] Creating offline snapshot 577a7952-bd3d-4f94-9b0d-5a4daabd4e07 of volume a91ab8d2-53ee-431e-b70b-bb6595c37739 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa7d4d2-7afe-4636-9f3b-adec6758edee]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:02 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03" returned: 0 in 0.477s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:02 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03 Sep 28 17:22:02 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:02 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739 Sep 28 17:22:02 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:02 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8958fb13-bb40-421c-a292-31fe47e30c03" returned: 0 in 0.283s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-quobyte-8958fb13-bb40-421c-a292-31fe47e30c03" released by "delete_volume" :: held 0.839s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:02 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739" returned: 0 in 0.445s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] Created reservations ['770d0817-38d2-46af-9472-e78df96166c5', 'efe259aa-8487-4739-ac10-f195e2ccd4fd', '701b4144-05f1-4c60-9bc8-f1838f23e3ce', 'd63d1555-999c-4992-bfd1-77b024d1bfd5'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:02 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07 1G Sep 28 17:22:02 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:02 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:22:02 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] Acquiring lock "cinder-1e770d29-825c-4e5f-a6bb-6cdea38bf10a-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-1e770d29-825c-4e5f-a6bb-6cdea38bf10a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] Acquiring lock "cinder-quobyte-1e770d29-825c-4e5f-a6bb-6cdea38bf10a" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-quobyte-1e770d29-825c-4e5f-a6bb-6cdea38bf10a" acquired by "delete_volume" :: waited 0.016s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b100c3-1fc8-4d00-bbf7-c64a9c6bf3c5]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:02 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.327s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:02 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:03 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] Deleted volume successfully. Sep 28 17:22:03 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a Sep 28 17:22:03 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fe5ffc95-560b-4d9d-9d72-51308b765d4d tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-8958fb13-bb40-421c-a292-31fe47e30c03-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:03 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07 1G" returned: 0 in 0.553s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a91ab8d2-53ee-431e-b70b-bb6595c37739 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:03 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a91ab8d2-53ee-431e-b70b-bb6595c37739 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07 Sep 28 17:22:03 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:03 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a" returned: 0 in 0.445s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:03 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a Sep 28 17:22:03 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:03 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a91ab8d2-53ee-431e-b70b-bb6595c37739 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07" returned: 0 in 0.359s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:03 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07 is being set with open permissions: ugo+rw Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:03 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07 Sep 28 17:22:03 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:03 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1e770d29-825c-4e5f-a6bb-6cdea38bf10a" returned: 0 in 0.316s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-quobyte-1e770d29-825c-4e5f-a6bb-6cdea38bf10a" released by "delete_volume" :: held 0.820s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] Created reservations ['027e7522-f05f-4cc0-8316-4afaeb15da5a', 'effe3e33-6144-4041-9d8a-f71014e23660', '300d413e-51bb-4147-8ad0-797f8fc87314', '7c674aba-6805-4cbc-97e8-9ad8a1ab684e'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:03 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07" returned: 0 in 0.346s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:03 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:22:03 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:03 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.info Sep 28 17:22:03 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:04 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.395s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:04 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:04 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] Deleted volume successfully. Sep 28 17:22:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f191a0a0-baa8-456a-bb8a-4a6d4f64db42 tempest-SnapshotDependencyTests-1380882697 None] Lock "cinder-1e770d29-825c-4e5f-a6bb-6cdea38bf10a-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:04 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.info" returned: 0 in 0.431s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:04 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.info is being set with open permissions: ugo+rw Sep 28 17:22:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:04 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.info Sep 28 17:22:04 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:04 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.info" returned: 0 in 0.314s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.618s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:04 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-02aa1b75-b13a-4b41-9373-b3ebc9564b96 tempest-CinderUnicodeTest-1991244623 None] Create snapshot completed successfully Sep 28 17:22:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] Acquiring lock "cinder-577a7952-bd3d-4f94-9b0d-5a4daabd4e07-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] Lock "cinder-577a7952-bd3d-4f94-9b0d-5a4daabd4e07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] Acquiring lock "cinder-quobyte-a91ab8d2-53ee-431e-b70b-bb6595c37739" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] Lock "cinder-quobyte-a91ab8d2-53ee-431e-b70b-bb6595c37739" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] Acquiring lock "cinder-quobyte-577a7952-bd3d-4f94-9b0d-5a4daabd4e07" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] Lock "cinder-quobyte-577a7952-bd3d-4f94-9b0d-5a4daabd4e07" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] Deleting offline snapshot 577a7952-bd3d-4f94-9b0d-5a4daabd4e07 of volume a91ab8d2-53ee-431e-b70b-bb6595c37739 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:22:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] snapshot_file for this snap is: volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:22:05 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1bdc45-9999-4a92-882d-97b67a00f149]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:05 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07 Sep 28 17:22:05 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:05 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07" returned: 0 in 0.419s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a91ab8d2-53ee-431e-b70b-bb6595c37739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:22:05 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbee0af-8b43-433a-920e-168fa4a4226a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:06 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739 Sep 28 17:22:06 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:06 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739" returned: 0 in 0.448s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:06 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07 Sep 28 17:22:06 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:06 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07" returned: 0 in 0.480s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:06 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07 Sep 28 17:22:06 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:07 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739.577a7952-bd3d-4f94-9b0d-5a4daabd4e07" returned: 0 in 0.343s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] Lock "cinder-quobyte-577a7952-bd3d-4f94-9b0d-5a4daabd4e07" released by "_delete_snapshot" :: held 1.860s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] Lock "cinder-quobyte-a91ab8d2-53ee-431e-b70b-bb6595c37739" released by "delete_snapshot" :: held 1.894s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:07 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] Created reservations ['9f6cdfc9-4227-4622-9e86-2582b7574fdc', 'f126649f-c6ff-4030-84d3-9c09daee5d31', '242d8855-09fa-43cc-9910-fec867b66ed0', '57865948-b3d1-4ca3-80c0-bd09bd700b08'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:07 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] Delete snapshot completed successfully. Sep 28 17:22:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-15112720-77f3-4b20-a17b-9baa3c3aba38 tempest-CinderUnicodeTest-1991244623 None] Lock "cinder-577a7952-bd3d-4f94-9b0d-5a4daabd4e07-delete_snapshot" released by "delete_snapshot" :: held 2.110s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] Acquiring lock "cinder-a91ab8d2-53ee-431e-b70b-bb6595c37739-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] Lock "cinder-a91ab8d2-53ee-431e-b70b-bb6595c37739-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] Acquiring lock "cinder-quobyte-a91ab8d2-53ee-431e-b70b-bb6595c37739" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] Lock "cinder-quobyte-a91ab8d2-53ee-431e-b70b-bb6595c37739" acquired by "delete_volume" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:07 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd36f91-e895-4358-ac0d-b604803d33bc]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:07 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739 Sep 28 17:22:07 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:08 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739" returned: 0 in 0.391s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:08 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739 Sep 28 17:22:08 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:08 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a91ab8d2-53ee-431e-b70b-bb6595c37739" returned: 0 in 0.280s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] Lock "cinder-quobyte-a91ab8d2-53ee-431e-b70b-bb6595c37739" released by "delete_volume" :: held 0.743s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:08 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] Created reservations ['52ebb13d-358a-4b59-b135-8870bb4264f6', '1b91433e-b38b-4805-8b8f-b4108b1e3de9', '3457cc31-571e-4f8d-a1c6-bba4e55e7187', '8e6e1c88-66eb-440b-9e7f-3807b33bdba6'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:08 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:22:08 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] Acquiring lock "cinder-a756bcdc-68d4-4a8e-9475-d83736ff1dbc-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] Lock "cinder-a756bcdc-68d4-4a8e-9475-d83736ff1dbc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] Acquiring lock "cinder-quobyte-a756bcdc-68d4-4a8e-9475-d83736ff1dbc" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:08 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.437s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:08 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] Lock "cinder-quobyte-a756bcdc-68d4-4a8e-9475-d83736ff1dbc" acquired by "delete_volume" :: waited 0.062s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:08 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] Deleted volume successfully. Sep 28 17:22:09 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5322ef-573f-4ae4-b74e-15dec1f943f2]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a756bcdc-68d4-4a8e-9475-d83736ff1dbc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4d9e76fc-3520-4eb8-8107-e035b360212b tempest-CinderUnicodeTest-1991244623 None] Lock "cinder-a91ab8d2-53ee-431e-b70b-bb6595c37739-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:09 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a756bcdc-68d4-4a8e-9475-d83736ff1dbc Sep 28 17:22:09 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:09 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a756bcdc-68d4-4a8e-9475-d83736ff1dbc" returned: 0 in 0.429s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a756bcdc-68d4-4a8e-9475-d83736ff1dbc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:09 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a756bcdc-68d4-4a8e-9475-d83736ff1dbc Sep 28 17:22:09 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:09 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a756bcdc-68d4-4a8e-9475-d83736ff1dbc" returned: 0 in 0.327s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] Lock "cinder-quobyte-a756bcdc-68d4-4a8e-9475-d83736ff1dbc" released by "delete_volume" :: held 0.825s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:09 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] Created reservations ['cf322480-22c8-4815-8d3b-2c0361d0a936', '1838d4d9-1baa-4147-9359-f5a39e5f8c3f', '721e83d6-1d45-4d3b-8425-3c32dbe30ba3', '20dd6e56-83f5-4566-b266-37001a6c09c7'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:10 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:22:10 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:10 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.409s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:10 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:10 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] Deleted volume successfully. Sep 28 17:22:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-655decae-6434-48fe-9199-52113f8aa2ad tempest-CinderUnicodeTest-1991244623 None] Lock "cinder-a756bcdc-68d4-4a8e-9475-d83736ff1dbc-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:19 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=74,cinder:INSERT=29,cinder:UPDATE=85,cinder:DELETE=2 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:22:20 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=73,cinder:UPDATE=82,cinder:INSERT=30,cinder:DELETE=12 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Flow 'volume_create_manager' (23467568-a0c1-477f-af86-8f1bac3c8c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402d777a-0a89-40e5-b7a2-c0134eb86005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402d777a-0a89-40e5-b7a2-c0134eb86005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-323640491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfaafb98-5405-4fa8-8714-ae81520a65b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffbce249d0a44e7a41cca8f5bd6848d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:29Z,use_quota=True,user_id='ee517e1552494eecac26ef51f10b1acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432cc679-9d00-4a18-9515-3b6629a4fc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432cc679-9d00-4a18-9515-3b6629a4fc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874546fe-4075-4738-a168-9fa76a975dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874546fe-4075-4738-a168-9fa76a975dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfaafb98-5405-4fa8-8714-ae81520a65b7', 'volume_name': 'volume-cfaafb98-5405-4fa8-8714-ae81520a65b7', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab933e53-bf9e-4172-96aa-a81055b4b3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab933e53-bf9e-4172-96aa-a81055b4b3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbcb4b89-1ae6-4f94-98b0-98490c6387e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:29 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Volume cfaafb98-5405-4fa8-8714-ae81520a65b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfaafb98-5405-4fa8-8714-ae81520a65b7', 'volume_size': 1} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-323640491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfaafb98-5405-4fa8-8714-ae81520a65b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffbce249d0a44e7a41cca8f5bd6848d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:29Z,use_quota=True,user_id='ee517e1552494eecac26ef51f10b1acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Creating volume cfaafb98-5405-4fa8-8714-ae81520a65b7 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:29 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfaafb98-5405-4fa8-8714-ae81520a65b7 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:29 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfaafb98-5405-4fa8-8714-ae81520a65b7 1073741824 Sep 28 17:22:29 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Flow 'volume_create_manager' (bc4c3caf-41e7-4ba7-9ec6-2e7c9814747e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d2ee1e-6ac9-4425-a026-6abb8ac9e73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d2ee1e-6ac9-4425-a026-6abb8ac9e73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-896374051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e13196-3b4b-4199-80b3-47a5b050e0e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e436d19dcd47e2a55c974347682283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:29Z,use_quota=True,user_id='3bb01837c8b24c258a75000cb10e98a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7663a0f-8357-4d14-9683-cc548a9a7282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7663a0f-8357-4d14-9683-cc548a9a7282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412b69cd-bdf7-4712-a30e-275d8dfbb613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412b69cd-bdf7-4712-a30e-275d8dfbb613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20e13196-3b4b-4199-80b3-47a5b050e0e5', 'volume_name': 'volume-20e13196-3b4b-4199-80b3-47a5b050e0e5', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca244a6-81c9-41ce-8b8f-2ca028661146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca244a6-81c9-41ce-8b8f-2ca028661146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa9b3c3-42a4-47f9-adf0-90597d289317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:29 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Volume 20e13196-3b4b-4199-80b3-47a5b050e0e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20e13196-3b4b-4199-80b3-47a5b050e0e5', 'volume_size': 1} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Flow 'volume_create_manager' (b047c131-183a-4f8b-afc2-294dac37b741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c74f29f-abb7-4f53-a481-f61ef14ba795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c74f29f-abb7-4f53-a481-f61ef14ba795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-585191769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca820b55-fc22-490b-a709-a8e12247c031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffbce249d0a44e7a41cca8f5bd6848d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:30Z,use_quota=True,user_id='ee517e1552494eecac26ef51f10b1acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f686cda-a0a3-4b63-8dfa-9f344df60e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f686cda-a0a3-4b63-8dfa-9f344df60e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:29 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089f6ed5-14d7-4602-afc6-b38ca8f8c701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089f6ed5-14d7-4602-afc6-b38ca8f8c701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca820b55-fc22-490b-a709-a8e12247c031', 'volume_name': 'volume-ca820b55-fc22-490b-a709-a8e12247c031', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ac8973-5d0e-4e3f-a381-69cee4bcc11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ac8973-5d0e-4e3f-a381-69cee4bcc11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd42b0f7-a225-49ff-9d8a-c89fc82fe62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:30 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Volume ca820b55-fc22-490b-a709-a8e12247c031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca820b55-fc22-490b-a709-a8e12247c031', 'volume_size': 1} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:30 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfaafb98-5405-4fa8-8714-ae81520a65b7 1073741824" returned: 0 in 0.778s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfaafb98-5405-4fa8-8714-ae81520a65b7 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:30 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfaafb98-5405-4fa8-8714-ae81520a65b7 Sep 28 17:22:30 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Flow 'volume_create_manager' (668843e3-4ac9-4a1b-a929-6a1a4251fb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b33b0d2-dc49-4d12-a1cf-9001fc96207c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b33b0d2-dc49-4d12-a1cf-9001fc96207c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1507677937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68440495-eab6-46bb-9146-ba321f216185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffbce249d0a44e7a41cca8f5bd6848d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:30Z,use_quota=True,user_id='ee517e1552494eecac26ef51f10b1acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd91f421-0063-49ef-a1d6-3afdf74a6b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd91f421-0063-49ef-a1d6-3afdf74a6b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b39d59-ad56-40e3-b8b6-39ded33ccae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b39d59-ad56-40e3-b8b6-39ded33ccae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68440495-eab6-46bb-9146-ba321f216185', 'volume_name': 'volume-68440495-eab6-46bb-9146-ba321f216185', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd23c40-ae04-47f9-bcd4-9ef91bb6663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd23c40-ae04-47f9-bcd4-9ef91bb6663d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5ca872-cf28-409d-b4de-b5f719feb252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:30 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Volume 68440495-eab6-46bb-9146-ba321f216185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68440495-eab6-46bb-9146-ba321f216185', 'volume_size': 1} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:30 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfaafb98-5405-4fa8-8714-ae81520a65b7" returned: 0 in 0.478s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.856s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-896374051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e13196-3b4b-4199-80b3-47a5b050e0e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e436d19dcd47e2a55c974347682283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:29Z,use_quota=True,user_id='3bb01837c8b24c258a75000cb10e98a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Creating volume 20e13196-3b4b-4199-80b3-47a5b050e0e5 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:30 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:30 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 1073741824 Sep 28 17:22:30 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbcb4b89-1ae6-4f94-98b0-98490c6387e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfaafb98-5405-4fa8-8714-ae81520a65b7', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08327872-abfd-45a9-a428-9e0aca4faabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:30 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Volume volume-cfaafb98-5405-4fa8-8714-ae81520a65b7 (cfaafb98-5405-4fa8-8714-ae81520a65b7): created successfully Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08327872-abfd-45a9-a428-9e0aca4faabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Flow 'volume_create_manager' (23467568-a0c1-477f-af86-8f1bac3c8c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:30 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-c1564f2c-7403-47ff-99f6-06ebf3653681 tempest-CreateVolumesFromImageTest-734638435 None] Created volume successfully. Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Flow 'volume_create_manager' (f01b01ca-9b19-4a4e-9c10-b55e09468ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b42fbb-b1dd-42aa-98fa-e55a4079b1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b42fbb-b1dd-42aa-98fa-e55a4079b1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2084217365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0361a1-00fc-4408-98ef-dc765a3a1758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffbce249d0a44e7a41cca8f5bd6848d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:31Z,use_quota=True,user_id='ee517e1552494eecac26ef51f10b1acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6e6594-e349-468d-b693-af6b1604895a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6e6594-e349-468d-b693-af6b1604895a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f736d9-9660-4ec9-ba95-965b312a3074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f736d9-9660-4ec9-ba95-965b312a3074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0361a1-00fc-4408-98ef-dc765a3a1758', 'volume_name': 'volume-ee0361a1-00fc-4408-98ef-dc765a3a1758', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d02b58-750c-4389-b1a5-ea09b78347fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d02b58-750c-4389-b1a5-ea09b78347fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d70412-1965-441f-942c-2b18df3b1e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:31 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Volume ee0361a1-00fc-4408-98ef-dc765a3a1758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0361a1-00fc-4408-98ef-dc765a3a1758', 'volume_size': 1} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:31 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 1073741824" returned: 0 in 0.703s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:31 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 Sep 28 17:22:31 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Flow 'volume_create_manager' (014a46d6-e6f0-4384-9195-d0b6fbc12c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d046a712-8b9b-48fe-acba-ea7bd58df8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d046a712-8b9b-48fe-acba-ea7bd58df8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-810973240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34dc1fb9-c15c-4701-aa80-aefc9be398c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffbce249d0a44e7a41cca8f5bd6848d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:32Z,use_quota=True,user_id='ee517e1552494eecac26ef51f10b1acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c8e914-f2c7-473c-bc3d-988d8359c0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c8e914-f2c7-473c-bc3d-988d8359c0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5959cd-7a85-4683-b3d0-f57b1d68786b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5959cd-7a85-4683-b3d0-f57b1d68786b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34dc1fb9-c15c-4701-aa80-aefc9be398c4', 'volume_name': 'volume-34dc1fb9-c15c-4701-aa80-aefc9be398c4', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd04d7d-cb3a-4475-9df8-84272b0e8f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd04d7d-cb3a-4475-9df8-84272b0e8f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f72b942-0159-4cf0-8fbf-e93f5b51fc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:31 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Volume 34dc1fb9-c15c-4701-aa80-aefc9be398c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34dc1fb9-c15c-4701-aa80-aefc9be398c4', 'volume_size': 1} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:31 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5" returned: 0 in 0.397s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.805s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-585191769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca820b55-fc22-490b-a709-a8e12247c031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffbce249d0a44e7a41cca8f5bd6848d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:30Z,use_quota=True,user_id='ee517e1552494eecac26ef51f10b1acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Creating volume ca820b55-fc22-490b-a709-a8e12247c031 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:31 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ca820b55-fc22-490b-a709-a8e12247c031 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa9b3c3-42a4-47f9-adf0-90597d289317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e13196-3b4b-4199-80b3-47a5b050e0e5', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:31 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ca820b55-fc22-490b-a709-a8e12247c031 1073741824 Sep 28 17:22:31 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139b7166-3989-47da-b0dd-95c2c91639e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:31 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Volume volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 (20e13196-3b4b-4199-80b3-47a5b050e0e5): created successfully Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139b7166-3989-47da-b0dd-95c2c91639e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Flow 'volume_create_manager' (bc4c3caf-41e7-4ba7-9ec6-2e7c9814747e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:31 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-19a1e7b7-74a0-45c3-a349-9f29412d1965 tempest-VolumeDependencyTests-622274781 None] Created volume successfully. Sep 28 17:22:32 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ca820b55-fc22-490b-a709-a8e12247c031 1073741824" returned: 0 in 0.705s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ca820b55-fc22-490b-a709-a8e12247c031 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:32 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ca820b55-fc22-490b-a709-a8e12247c031 Sep 28 17:22:32 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:32 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Flow 'volume_create_manager' (56f783de-bc98-469e-a2a5-fa78b17bb50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce64187e-5ce9-4824-8833-deb4b1b1841c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ca820b55-fc22-490b-a709-a8e12247c031" returned: 0 in 0.309s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.298s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1507677937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68440495-eab6-46bb-9146-ba321f216185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffbce249d0a44e7a41cca8f5bd6848d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:30Z,use_quota=True,user_id='ee517e1552494eecac26ef51f10b1acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Creating volume 68440495-eab6-46bb-9146-ba321f216185 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:32 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68440495-eab6-46bb-9146-ba321f216185 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:32 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68440495-eab6-46bb-9146-ba321f216185 1073741824 Sep 28 17:22:32 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce64187e-5ce9-4824-8833-deb4b1b1841c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2845e5d-087b-487c-bb3b-4480196bc13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c61dfede94496287a931213eb544c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:33Z,use_quota=True,user_id='937a2a27fb1e4800a0720f1ca93af2a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c76812a-8016-4562-8bfb-57d7986a5fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c76812a-8016-4562-8bfb-57d7986a5fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d2aefd-039e-4ce5-b6b7-8d1654a0c7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:32 devstack cinder-volume[86970]: DEBUG cinder.image.glance [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Creating Keystone auth plugin from conf {{(pid=86970) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd42b0f7-a225-49ff-9d8a-c89fc82fe62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca820b55-fc22-490b-a709-a8e12247c031', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caefe605-5f2f-4779-b479-30eb076d4c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:33 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Volume volume-ca820b55-fc22-490b-a709-a8e12247c031 (ca820b55-fc22-490b-a709-a8e12247c031): created successfully Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caefe605-5f2f-4779-b479-30eb076d4c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Flow 'volume_create_manager' (b047c131-183a-4f8b-afc2-294dac37b741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:33 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1fe13b0a-36c1-45f4-a94b-ade7d7d94b0e tempest-CreateVolumesFromImageTest-734638435 None] Created volume successfully. Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d2aefd-039e-4ce5-b6b7-8d1654a0c7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e2845e5d-087b-487c-bb3b-4480196bc13e', 'volume_name': 'volume-e2845e5d-087b-487c-bb3b-4480196bc13e', 'volume_size': 1, 'image_id': '2e1545fb-650a-40dd-8617-77cfd311279a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e1545fb-650a-40dd-8617-77cfd311279a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a63363866632c07f2a5715edff6e3e9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c5c61dfede94496287a931213eb544c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71892eac286a6273fadf3866e291af349aebce6ef418f018b3de0994ccc62e836f20886e81f9883eb957f31a9e1b0cabe5f830adbece82a54f1a26951f73da9e', 'id': '2e1545fb-650a-40dd-8617-77cfd311279a', 'created_at': datetime.datetime(2026, 9, 28, 15, 22, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 22, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e1545fb-650a-40dd-8617-77cfd311279a/file', 'properties': {}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df98ea71-44ac-458c-88b8-6490ac19f3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df98ea71-44ac-458c-88b8-6490ac19f3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16cd93b-c1ae-4ce8-b2c5-bc33a9bd68a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:33 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Volume e2845e5d-087b-487c-bb3b-4480196bc13e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e2845e5d-087b-487c-bb3b-4480196bc13e', 'volume_size': 1, 'image_id': '2e1545fb-650a-40dd-8617-77cfd311279a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e1545fb-650a-40dd-8617-77cfd311279a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a63363866632c07f2a5715edff6e3e9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c5c61dfede94496287a931213eb544c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71892eac286a6273fadf3866e291af349aebce6ef418f018b3de0994ccc62e836f20886e81f9883eb957f31a9e1b0cabe5f830adbece82a54f1a26951f73da9e', 'id': '2e1545fb-650a-40dd-8617-77cfd311279a', 'created_at': datetime.datetime(2026, 9, 28, 15, 22, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 22, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e1545fb-650a-40dd-8617-77cfd311279a/file', 'properties': {}}, 'image_service': } Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Trying to clone e2845e5d-087b-487c-bb3b-4480196bc13e from image 2e1545fb-650a-40dd-8617-77cfd311279a at location (None, [{'url': 'file:///opt/stack/data/glance/images/2e1545fb-650a-40dd-8617-77cfd311279a', 'metadata': {}}]). {{(pid=86970) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:22:33 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:22:33 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68440495-eab6-46bb-9146-ba321f216185 1073741824" returned: 0 in 0.577s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b818993a-bd01-4bdb-a059-53b48005d65f]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68440495-eab6-46bb-9146-ba321f216185 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:33 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68440495-eab6-46bb-9146-ba321f216185 Sep 28 17:22:33 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:33 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD Sep 28 17:22:33 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:33 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68440495-eab6-46bb-9146-ba321f216185" returned: 0 in 0.297s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.568s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2084217365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0361a1-00fc-4408-98ef-dc765a3a1758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffbce249d0a44e7a41cca8f5bd6848d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:31Z,use_quota=True,user_id='ee517e1552494eecac26ef51f10b1acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Creating volume ee0361a1-00fc-4408-98ef-dc765a3a1758 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:33 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ee0361a1-00fc-4408-98ef-dc765a3a1758 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5ca872-cf28-409d-b4de-b5f719feb252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68440495-eab6-46bb-9146-ba321f216185', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:33 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ee0361a1-00fc-4408-98ef-dc765a3a1758 1073741824 Sep 28 17:22:33 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e092e1-8791-4692-b9ab-3902ecc8bee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:33 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Volume volume-68440495-eab6-46bb-9146-ba321f216185 (68440495-eab6-46bb-9146-ba321f216185): created successfully Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e092e1-8791-4692-b9ab-3902ecc8bee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Flow 'volume_create_manager' (668843e3-4ac9-4a1b-a929-6a1a4251fb8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:33 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0a871be0-f017-4132-8950-5469e150f38d tempest-CreateVolumesFromImageTest-734638435 None] Created volume successfully. Sep 28 17:22:34 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:34 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD Sep 28 17:22:34 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:34 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD" returned: 1 in 0.421s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Temporary image 2e1545fb-650a-40dd-8617-77cfd311279a is fetched for user 937a2a27fb1e4800a0720f1ca93af2a0. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:22:34 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ee0361a1-00fc-4408-98ef-dc765a3a1758 1073741824" returned: 0 in 0.560s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ee0361a1-00fc-4408-98ef-dc765a3a1758 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f108e59e-a146-4515-86b4-a7346c153f84]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:34 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ee0361a1-00fc-4408-98ef-dc765a3a1758 Sep 28 17:22:34 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Flow 'volume_create_manager' (bc813e83-7168-491c-8f16-4dee0c2d0064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f11359d-bda9-4de5-b0a5-82ca873f49ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f11359d-bda9-4de5-b0a5-82ca873f49ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01e8971-9d4c-4afa-97e1-0169a7e8fec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='674a62578eaf46f68d1c57c0996249ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:35Z,use_quota=True,user_id='cc03798042554e2fb477348d27fb80a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4487025d-f783-4509-9d88-3b40188310cd),volume_type_id=4487025d-f783-4509-9d88-3b40188310cd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a734548-65a7-4a03-a7ff-2241d7eb56cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:34 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD Sep 28 17:22:34 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a734548-65a7-4a03-a7ff-2241d7eb56cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2c6685-b727-4b26-8ac7-7d2402c78ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.image.glance [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Creating Keystone auth plugin from conf {{(pid=86970) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:22:34 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ee0361a1-00fc-4408-98ef-dc765a3a1758" returned: 0 in 0.344s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.084s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-810973240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34dc1fb9-c15c-4701-aa80-aefc9be398c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffbce249d0a44e7a41cca8f5bd6848d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:32Z,use_quota=True,user_id='ee517e1552494eecac26ef51f10b1acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Creating volume 34dc1fb9-c15c-4701-aa80-aefc9be398c4 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:34 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:34 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34dc1fb9-c15c-4701-aa80-aefc9be398c4 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:34 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34dc1fb9-c15c-4701-aa80-aefc9be398c4 1073741824 Sep 28 17:22:34 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d70412-1965-441f-942c-2b18df3b1e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0361a1-00fc-4408-98ef-dc765a3a1758', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192ddb69-f992-4148-8167-67d9481d2e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:34 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Volume volume-ee0361a1-00fc-4408-98ef-dc765a3a1758 (ee0361a1-00fc-4408-98ef-dc765a3a1758): created successfully Sep 28 17:22:34 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192ddb69-f992-4148-8167-67d9481d2e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Flow 'volume_create_manager' (f01b01ca-9b19-4a4e-9c10-b55e09468ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:35 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-b8e2b07e-d27a-4619-ad75-e25482aa7a42 tempest-CreateVolumesFromImageTest-734638435 None] Created volume successfully. Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2c6685-b727-4b26-8ac7-7d2402c78ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e01e8971-9d4c-4afa-97e1-0169a7e8fec5', 'volume_name': 'volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5', 'volume_size': 1, 'image_id': 'c3da261a-d417-4f02-9308-85f4e3cc047f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3da261a-d417-4f02-9308-85f4e3cc047f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42f5a4d8890828d5d77ca613725bc240', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '674a62578eaf46f68d1c57c0996249ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b014363a07c096bef4ecd53112e6b7c5c9fc92ddc1be748c4bac98c34d66f97adb81e1c8ec7071bab6f432fea92c679d6977eff1af7701e8d1705fd0225c1582', 'id': 'c3da261a-d417-4f02-9308-85f4e3cc047f', 'created_at': datetime.datetime(2026, 9, 28, 15, 22, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 22, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3da261a-d417-4f02-9308-85f4e3cc047f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a977b9a-da06-4341-9401-4573a1c32641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a977b9a-da06-4341-9401-4573a1c32641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b71539d-5c6e-4f01-b480-2a025b6909fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:35 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Volume e01e8971-9d4c-4afa-97e1-0169a7e8fec5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5', 'volume_size': 1, 'image_id': 'c3da261a-d417-4f02-9308-85f4e3cc047f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3da261a-d417-4f02-9308-85f4e3cc047f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42f5a4d8890828d5d77ca613725bc240', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '674a62578eaf46f68d1c57c0996249ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b014363a07c096bef4ecd53112e6b7c5c9fc92ddc1be748c4bac98c34d66f97adb81e1c8ec7071bab6f432fea92c679d6977eff1af7701e8d1705fd0225c1582', 'id': 'c3da261a-d417-4f02-9308-85f4e3cc047f', 'created_at': datetime.datetime(2026, 9, 28, 15, 22, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 22, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3da261a-d417-4f02-9308-85f4e3cc047f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Trying to clone e01e8971-9d4c-4afa-97e1-0169a7e8fec5 from image c3da261a-d417-4f02-9308-85f4e3cc047f at location (None, [{'url': 'file:///opt/stack/data/glance/images/c3da261a-d417-4f02-9308-85f4e3cc047f', 'metadata': {}}]). {{(pid=86970) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:22:35 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD Sep 28 17:22:35 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:22:35 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c80e29e-1e45-4160-99f2-560cd54620be]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:35 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD" returned: 1 in 0.415s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:35 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD Sep 28 17:22:35 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:35 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34dc1fb9-c15c-4701-aa80-aefc9be398c4 1073741824" returned: 0 in 0.652s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34dc1fb9-c15c-4701-aa80-aefc9be398c4 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:35 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34dc1fb9-c15c-4701-aa80-aefc9be398c4 Sep 28 17:22:35 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:35 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:35 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD Sep 28 17:22:35 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:35 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34dc1fb9-c15c-4701-aa80-aefc9be398c4" returned: 0 in 0.275s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.996s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f72b942-0159-4cf0-8fbf-e93f5b51fc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34dc1fb9-c15c-4701-aa80-aefc9be398c4', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa660981-1f5b-43db-a927-3740450062a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] Creating offline snapshot 47a1dcea-80da-44e5-a9fe-2e68cb9af804 of volume 20e13196-3b4b-4199-80b3-47a5b050e0e5 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:22:35 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Volume volume-34dc1fb9-c15c-4701-aa80-aefc9be398c4 (34dc1fb9-c15c-4701-aa80-aefc9be398c4): created successfully Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa660981-1f5b-43db-a927-3740450062a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Flow 'volume_create_manager' (014a46d6-e6f0-4384-9195-d0b6fbc12c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[686faa28-0f67-4311-945d-bae1360db537]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:35 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ec22660b-8d42-4a92-9949-21638ec626e6 tempest-CreateVolumesFromImageTest-734638435 None] Created volume successfully. Sep 28 17:22:36 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Temporary image c3da261a-d417-4f02-9308-85f4e3cc047f is fetched for user cc03798042554e2fb477348d27fb80a3. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:22:36 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 Sep 28 17:22:36 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27de605-ab8b-4468-8d61-07fd0cb07458]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:36 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD Sep 28 17:22:36 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "cinder-34dc1fb9-c15c-4701-aa80-aefc9be398c4-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-34dc1fb9-c15c-4701-aa80-aefc9be398c4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "cinder-quobyte-34dc1fb9-c15c-4701-aa80-aefc9be398c4" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-quobyte-34dc1fb9-c15c-4701-aa80-aefc9be398c4" acquired by "delete_volume" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a4413d-0f82-4dbc-b60c-82884f8fa641]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34dc1fb9-c15c-4701-aa80-aefc9be398c4 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:36 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5" returned: 0 in 0.518s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:36 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804 1G Sep 28 17:22:36 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:36 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:36 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34dc1fb9-c15c-4701-aa80-aefc9be398c4 Sep 28 17:22:36 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:36 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD Sep 28 17:22:36 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:36 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34dc1fb9-c15c-4701-aa80-aefc9be398c4" returned: 0 in 0.487s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34dc1fb9-c15c-4701-aa80-aefc9be398c4 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:36 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:36 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34dc1fb9-c15c-4701-aa80-aefc9be398c4 Sep 28 17:22:36 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD" returned: 1 in 0.430s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:22:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:37 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804 1G" returned: 0 in 0.564s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:37 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804 Sep 28 17:22:37 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:37 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-34dc1fb9-c15c-4701-aa80-aefc9be398c4" returned: 0 in 0.305s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-quobyte-34dc1fb9-c15c-4701-aa80-aefc9be398c4" released by "delete_volume" :: held 0.841s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] Created reservations ['5e371437-f401-4660-8c81-347bd501d11d', 'bd8893c8-5e84-4bae-8830-a87226246c3c', '1ae89b7b-4b41-4c3f-8ea8-b1a09510561e', '1125bf92-d97d-4cc2-ab2f-fc6a79fe6355'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:37 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804" returned: 0 in 0.361s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:37 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804 is being set with open permissions: ugo+rw Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:37 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804 Sep 28 17:22:37 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:37 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:22:37 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "cinder-ee0361a1-00fc-4408-98ef-dc765a3a1758-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-ee0361a1-00fc-4408-98ef-dc765a3a1758-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "cinder-quobyte-ee0361a1-00fc-4408-98ef-dc765a3a1758" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-quobyte-ee0361a1-00fc-4408-98ef-dc765a3a1758" acquired by "delete_volume" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d0e446-2f53-48fa-94c7-627d05f971e8]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ee0361a1-00fc-4408-98ef-dc765a3a1758 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:37 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.379s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:37 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804" returned: 0 in 0.421s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:37 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] Deleted volume successfully. Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6efd7a19-1299-434b-b9c6-b20cbc8e1bca tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-34dc1fb9-c15c-4701-aa80-aefc9be398c4-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:37 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.info Sep 28 17:22:37 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ee0361a1-00fc-4408-98ef-dc765a3a1758 Sep 28 17:22:37 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:37 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:38 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.info" returned: 0 in 0.276s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:38 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.info is being set with open permissions: ugo+rw Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:38 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.info Sep 28 17:22:38 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:38 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ee0361a1-00fc-4408-98ef-dc765a3a1758" returned: 0 in 0.434s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ee0361a1-00fc-4408-98ef-dc765a3a1758 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:38 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ee0361a1-00fc-4408-98ef-dc765a3a1758 Sep 28 17:22:38 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:38 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.info" returned: 0 in 0.250s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.536s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.079s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2845e5d-087b-487c-bb3b-4480196bc13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c61dfede94496287a931213eb544c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:33Z,use_quota=True,user_id='937a2a27fb1e4800a0720f1ca93af2a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Creating volume e2845e5d-087b-487c-bb3b-4480196bc13e {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:38 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:38 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ee0361a1-00fc-4408-98ef-dc765a3a1758" returned: 0 in 0.253s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:38 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e 1073741824 Sep 28 17:22:38 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-quobyte-ee0361a1-00fc-4408-98ef-dc765a3a1758" released by "delete_volume" :: held 0.762s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:38 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-e0c30b4b-aed1-4c65-9410-6325703287ce tempest-VolumeDependencyTests-622274781 None] Create snapshot completed successfully Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] Created reservations ['bb36e501-e552-4171-903b-550498c9ddad', 'ab4ab5e9-0d33-4c4d-bde2-412c4f1649a9', 'eb73a1ae-5cf2-43cf-9e1d-8c64f626fc01', 'bf5e2255-f86a-4da0-9ddf-274a1f37ef64'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:38 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:22:38 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "cinder-68440495-eab6-46bb-9146-ba321f216185-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-68440495-eab6-46bb-9146-ba321f216185-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "cinder-quobyte-68440495-eab6-46bb-9146-ba321f216185" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-quobyte-68440495-eab6-46bb-9146-ba321f216185" acquired by "delete_volume" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb5f200-63d8-4ce2-b7bc-21bdc14b18ed]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68440495-eab6-46bb-9146-ba321f216185 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:38 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.316s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:38 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] Deleted volume successfully. Sep 28 17:22:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-6fbdd168-368a-4daf-bf55-7b6758d3fe6f tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-ee0361a1-00fc-4408-98ef-dc765a3a1758-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:39 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e 1073741824" returned: 0 in 0.627s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:39 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68440495-eab6-46bb-9146-ba321f216185 Sep 28 17:22:39 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:39 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e Sep 28 17:22:39 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:39 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68440495-eab6-46bb-9146-ba321f216185" returned: 0 in 0.450s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68440495-eab6-46bb-9146-ba321f216185 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:39 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68440495-eab6-46bb-9146-ba321f216185 Sep 28 17:22:39 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:39 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e" returned: 0 in 0.309s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.452s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01e8971-9d4c-4afa-97e1-0169a7e8fec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='674a62578eaf46f68d1c57c0996249ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:35Z,use_quota=True,user_id='cc03798042554e2fb477348d27fb80a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4487025d-f783-4509-9d88-3b40188310cd),volume_type_id=4487025d-f783-4509-9d88-3b40188310cd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Creating volume e01e8971-9d4c-4afa-97e1-0169a7e8fec5 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:39 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:39 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5 1073741824 Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Attempting download of 2e1545fb-650a-40dd-8617-77cfd311279a ((None, [{'url': 'file:///opt/stack/data/glance/images/2e1545fb-650a-40dd-8617-77cfd311279a', 'metadata': {}}])) to volume e2845e5d-087b-487c-bb3b-4480196bc13e. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:22:39 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa4bf96-cf3a-4f3c-933a-640edfdf5d01]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e1545fb-650a-40dd-8617-77cfd311279a_lyl7z_4y {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:39 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e1545fb-650a-40dd-8617-77cfd311279a_lyl7z_4y Sep 28 17:22:39 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:39 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-68440495-eab6-46bb-9146-ba321f216185" returned: 0 in 0.382s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-quobyte-68440495-eab6-46bb-9146-ba321f216185" released by "delete_volume" :: held 0.882s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] Created reservations ['64b71165-74da-4931-bbc1-d7813ed54f5a', '09c1fecf-d963-4495-a49e-6fded87943c4', 'cf239f2c-6215-48cc-a9c9-10d8742db648', 'f5c170f7-4ade-4e49-9686-1c791022a910'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:39 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Flow 'volume_create_manager' (8439a6d3-ac04-470d-a667-a6ea6ac7dffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d6799d-d591-4f60-8df9-cffc1262a9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d6799d-d591-4f60-8df9-cffc1262a9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-809753953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc85bba1-5dfd-4ae4-befa-4aebf02cd495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e436d19dcd47e2a55c974347682283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=47a1dcea-80da-44e5-a9fe-2e68cb9af804,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:40Z,use_quota=True,user_id='3bb01837c8b24c258a75000cb10e98a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:40 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:40 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:22:40 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5010ca-8270-44ed-be24-adfe7ce947e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5010ca-8270-44ed-be24-adfe7ce947e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:40 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9663fdc-67cf-4317-b99e-2fe9060fa265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9663fdc-67cf-4317-b99e-2fe9060fa265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bc85bba1-5dfd-4ae4-befa-4aebf02cd495', 'volume_name': 'volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495', 'volume_size': 1, 'snapshot_id': '47a1dcea-80da-44e5-a9fe-2e68cb9af804'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02f0473-8ebe-4303-b38f-6fdc3246cfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02f0473-8ebe-4303-b38f-6fdc3246cfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d991804e-e1f3-4ee7-a643-235be76cd50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:40 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Volume bc85bba1-5dfd-4ae4-befa-4aebf02cd495: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495', 'volume_size': 1, 'snapshot_id': '47a1dcea-80da-44e5-a9fe-2e68cb9af804'} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "cinder-ca820b55-fc22-490b-a709-a8e12247c031-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e1545fb-650a-40dd-8617-77cfd311279a_lyl7z_4y" returned: 0 in 0.593s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5 1073741824" returned: 0 in 0.717s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e1545fb-650a-40dd-8617-77cfd311279a_lyl7z_4y {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-ca820b55-fc22-490b-a709-a8e12247c031-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:40 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5 Sep 28 17:22:40 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "cinder-quobyte-ca820b55-fc22-490b-a709-a8e12247c031" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-quobyte-ca820b55-fc22-490b-a709-a8e12247c031" acquired by "delete_volume" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:40 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e1545fb-650a-40dd-8617-77cfd311279a_lyl7z_4y Sep 28 17:22:40 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[832169cb-8ed0-4e6f-9326-07d43c0c7515]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ca820b55-fc22-490b-a709-a8e12247c031 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:40 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.325s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:40 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] Deleted volume successfully. Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-736bd069-bde9-4a2c-a018-f0829c1da1f7 tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-68440495-eab6-46bb-9146-ba321f216185-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:40 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ca820b55-fc22-490b-a709-a8e12247c031 Sep 28 17:22:40 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:40 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e1545fb-650a-40dd-8617-77cfd311279a_lyl7z_4y" returned: 1 in 0.417s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e1545fb-650a-40dd-8617-77cfd311279a_lyl7z_4y' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de9cc9e-e232-4cba-83e7-afd99e247a55]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5" returned: 0 in 0.356s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:40 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.405s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Acquiring lock "cinder-quobyte-47a1dcea-80da-44e5-a9fe-2e68cb9af804-bc85bba1-5dfd-4ae4-befa-4aebf02cd495" by "_create_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Lock "cinder-quobyte-47a1dcea-80da-44e5-a9fe-2e68cb9af804-bc85bba1-5dfd-4ae4-befa-4aebf02cd495" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Creating volume bc85bba1-5dfd-4ae4-befa-4aebf02cd495 from snapshot 47a1dcea-80da-44e5-a9fe-2e68cb9af804 {{(pid=86970) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:40 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:40 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Acquiring lock "cinder-quobyte-bc85bba1-5dfd-4ae4-befa-4aebf02cd495" by "_copy_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Attempting download of c3da261a-d417-4f02-9308-85f4e3cc047f ((None, [{'url': 'file:///opt/stack/data/glance/images/c3da261a-d417-4f02-9308-85f4e3cc047f', 'metadata': {}}])) to volume e01e8971-9d4c-4afa-97e1-0169a7e8fec5. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Lock "cinder-quobyte-bc85bba1-5dfd-4ae4-befa-4aebf02cd495" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] snapshot: 47a1dcea-80da-44e5-a9fe-2e68cb9af804, volume: bc85bba1-5dfd-4ae4-befa-4aebf02cd495, {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[292753a7-b586-41a7-80e2-a55060ccd603]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3da261a-d417-4f02-9308-85f4e3cc047f_1ptxktan {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c0701b-fe94-4ceb-bb4e-5c24b1e30526]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:40 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ca820b55-fc22-490b-a709-a8e12247c031" returned: 0 in 0.497s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ca820b55-fc22-490b-a709-a8e12247c031 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:40 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ca820b55-fc22-490b-a709-a8e12247c031 Sep 28 17:22:40 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:40 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3da261a-d417-4f02-9308-85f4e3cc047f_1ptxktan Sep 28 17:22:40 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:40 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804 Sep 28 17:22:40 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:41 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD" returned: 0 in 0.613s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:41 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-ca820b55-fc22-490b-a709-a8e12247c031" returned: 0 in 0.377s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-quobyte-ca820b55-fc22-490b-a709-a8e12247c031" released by "delete_volume" :: held 0.948s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:41 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3da261a-d417-4f02-9308-85f4e3cc047f_1ptxktan" returned: 0 in 0.506s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3da261a-d417-4f02-9308-85f4e3cc047f_1ptxktan {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:41 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD Sep 28 17:22:41 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] Created reservations ['e1aa933d-b06e-4ba5-bbe2-729b6ec2ae5c', 'dd93974a-cc59-45be-bea1-2c1d4a622ce0', '7470a313-0a3f-4e23-b850-8e03c7f9306e', 'e5fa84ec-45b2-43d0-aa64-c984734a7088'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:41 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804" returned: 0 in 0.613s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20e13196-3b4b-4199-80b3-47a5b050e0e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b91079-1a1d-462d-929a-b30eb9999e57]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:41 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3da261a-d417-4f02-9308-85f4e3cc047f_1ptxktan Sep 28 17:22:41 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:41 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:22:41 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:41 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 Sep 28 17:22:41 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:41 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD" returned: 1 in 0.448s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] 2e1545fb-650a-40dd-8617-77cfd311279a was raw, converting to qcow2 {{(pid=86970) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:41 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3da261a-d417-4f02-9308-85f4e3cc047f_1ptxktan" returned: 1 in 0.395s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3da261a-d417-4f02-9308-85f4e3cc047f_1ptxktan' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc14454a-340e-496e-8333-40007551185f]: (4, 'raw') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:41 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e Sep 28 17:22:41 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:41 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.304s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:41 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] Deleted volume successfully. Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-88b7cc52-9fe6-40cb-9cd0-decbd0008cf3 tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-ca820b55-fc22-490b-a709-a8e12247c031-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:41 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD Sep 28 17:22:41 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:41 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5" returned: 0 in 0.451s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Creating direct copy from snapshot {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG cinder.utils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Path /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495 not found in is_blk_device check {{(pid=86970) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:22:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:41 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495 Sep 28 17:22:41 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:42 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:42 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD Sep 28 17:22:42 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:42 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e" returned: 0 in 0.571s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2e1545fb-650a-40dd-8617-77cfd311279a__rtkrgtudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:22:42 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:42 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e 1G Sep 28 17:22:42 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "cinder-cfaafb98-5405-4fa8-8714-ae81520a65b7-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-cfaafb98-5405-4fa8-8714-ae81520a65b7-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:42 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD" returned: 1 in 0.467s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] c3da261a-d417-4f02-9308-85f4e3cc047f was raw, converting to qcow2 {{(pid=86970) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:42 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5 Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "cinder-quobyte-cfaafb98-5405-4fa8-8714-ae81520a65b7" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:42 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-quobyte-cfaafb98-5405-4fa8-8714-ae81520a65b7" acquired by "delete_volume" :: waited 0.040s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1f80b7-ecba-45b7-a300-b21f0d9a2d09]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfaafb98-5405-4fa8-8714-ae81520a65b7 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:42 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e 1G" returned: 0 in 0.668s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Downloaded image 2e1545fb-650a-40dd-8617-77cfd311279a ((None, [{'url': 'file:///opt/stack/data/glance/images/2e1545fb-650a-40dd-8617-77cfd311279a', 'metadata': {}}])) to volume e2845e5d-087b-487c-bb3b-4480196bc13e successfully. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Temporary image 2e1545fb-650a-40dd-8617-77cfd311279a for user 937a2a27fb1e4800a0720f1ca93af2a0 is deleted. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Marking volume e2845e5d-087b-487c-bb3b-4480196bc13e as bootable. {{(pid=86970) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Copying metadata from image 2e1545fb-650a-40dd-8617-77cfd311279a to e2845e5d-087b-487c-bb3b-4480196bc13e. {{(pid=86970) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:22:42 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Creating volume glance metadata for volume e2845e5d-087b-487c-bb3b-4480196bc13e backed by image 2e1545fb-650a-40dd-8617-77cfd311279a with: {'image_id': '2e1545fb-650a-40dd-8617-77cfd311279a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8a63363866632c07f2a5715edff6e3e9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86970) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:22:43 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfaafb98-5405-4fa8-8714-ae81520a65b7 Sep 28 17:22:43 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:43 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16cd93b-c1ae-4ce8-b2c5-bc33a9bd68a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2845e5d-087b-487c-bb3b-4480196bc13e', 'volume_size': 1, 'image_id': '2e1545fb-650a-40dd-8617-77cfd311279a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e1545fb-650a-40dd-8617-77cfd311279a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a63363866632c07f2a5715edff6e3e9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c5c61dfede94496287a931213eb544c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71892eac286a6273fadf3866e291af349aebce6ef418f018b3de0994ccc62e836f20886e81f9883eb957f31a9e1b0cabe5f830adbece82a54f1a26951f73da9e', 'id': '2e1545fb-650a-40dd-8617-77cfd311279a', 'created_at': datetime.datetime(2026, 9, 28, 15, 22, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 22, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e1545fb-650a-40dd-8617-77cfd311279a/file', 'properties': {}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:43 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f57110-fe33-461f-b0a2-72afb0e3baad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:43 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Volume volume-e2845e5d-087b-487c-bb3b-4480196bc13e (e2845e5d-087b-487c-bb3b-4480196bc13e): created successfully Sep 28 17:22:43 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f57110-fe33-461f-b0a2-72afb0e3baad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:43 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Flow 'volume_create_manager' (56f783de-bc98-469e-a2a5-fa78b17bb50c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:43 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-e7fb17fe-45af-4bf1-b719-1ae3ef66869b tempest-VolumeImageDependencyTests-824515101 None] Created volume successfully. Sep 28 17:22:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] Acquiring lock "cinder-e2845e5d-087b-487c-bb3b-4480196bc13e-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:43 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfaafb98-5405-4fa8-8714-ae81520a65b7" returned: 0 in 1.091s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfaafb98-5405-4fa8-8714-ae81520a65b7 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] Lock "cinder-e2845e5d-087b-487c-bb3b-4480196bc13e-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:43 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfaafb98-5405-4fa8-8714-ae81520a65b7 Sep 28 17:22:43 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:43 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5" returned: 0 in 1.390s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:43 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c3da261a-d417-4f02-9308-85f4e3cc047f_kgpv9hdxdevstack@QuobyteHD, size 0.00 MB, duration 1.39 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5 {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:22:43 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:22:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:44 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5 1G Sep 28 17:22:44 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:44 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] Acquiring lock "cinder-quobyte-e2845e5d-087b-487c-bb3b-4480196bc13e" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:44 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] Lock "cinder-quobyte-e2845e5d-087b-487c-bb3b-4480196bc13e" acquired by "delete_volume" :: waited 0.047s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:44 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ea1858-a446-488c-b230-477b008c9865]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:44 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e Sep 28 17:22:44 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:44 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfaafb98-5405-4fa8-8714-ae81520a65b7" returned: 0 in 0.792s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:44 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-quobyte-cfaafb98-5405-4fa8-8714-ae81520a65b7" released by "delete_volume" :: held 2.000s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:44 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] Created reservations ['65f75e81-d0da-492a-85b3-d555eb8d3bf3', '1337931c-936f-4d1b-bfcf-4224405a8ca9', '18c95443-78f5-483f-9d32-18b9959fff96', 'df5cf31a-df17-425e-9af4-58e1f19d5d37'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:44 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:44 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:44 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5 1G" returned: 0 in 1.021s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:44 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Downloaded image c3da261a-d417-4f02-9308-85f4e3cc047f ((None, [{'url': 'file:///opt/stack/data/glance/images/c3da261a-d417-4f02-9308-85f4e3cc047f', 'metadata': {}}])) to volume e01e8971-9d4c-4afa-97e1-0169a7e8fec5 successfully. {{(pid=86970) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:22:44 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Temporary image c3da261a-d417-4f02-9308-85f4e3cc047f for user cc03798042554e2fb477348d27fb80a3 is deleted. {{(pid=86970) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:22:44 devstack cinder-volume[86970]: DEBUG cinder.volume.volume_utils [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Marking volume e01e8971-9d4c-4afa-97e1-0169a7e8fec5 as bootable. {{(pid=86970) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:22:45 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:22:45 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:45 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Copying metadata from image c3da261a-d417-4f02-9308-85f4e3cc047f to e01e8971-9d4c-4afa-97e1-0169a7e8fec5. {{(pid=86970) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:22:45 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Creating volume glance metadata for volume e01e8971-9d4c-4afa-97e1-0169a7e8fec5 backed by image c3da261a-d417-4f02-9308-85f4e3cc047f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c3da261a-d417-4f02-9308-85f4e3cc047f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '42f5a4d8890828d5d77ca613725bc240', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86970) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:22:45 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e" returned: 0 in 0.978s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:45 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e Sep 28 17:22:45 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b71539d-5c6e-4f01-b480-2a025b6909fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5', 'volume_size': 1, 'image_id': 'c3da261a-d417-4f02-9308-85f4e3cc047f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3da261a-d417-4f02-9308-85f4e3cc047f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42f5a4d8890828d5d77ca613725bc240', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '674a62578eaf46f68d1c57c0996249ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b014363a07c096bef4ecd53112e6b7c5c9fc92ddc1be748c4bac98c34d66f97adb81e1c8ec7071bab6f432fea92c679d6977eff1af7701e8d1705fd0225c1582', 'id': 'c3da261a-d417-4f02-9308-85f4e3cc047f', 'created_at': datetime.datetime(2026, 9, 28, 15, 22, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 22, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3da261a-d417-4f02-9308-85f4e3cc047f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a2ba38-ae84-4ec2-b881-496dc5607d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:45 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Volume volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5 (e01e8971-9d4c-4afa-97e1-0169a7e8fec5): created successfully Sep 28 17:22:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a2ba38-ae84-4ec2-b881-496dc5607d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Flow 'volume_create_manager' (bc813e83-7168-491c-8f16-4dee0c2d0064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:45 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d76040bf-4905-453b-a456-bdf41867d428 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Created volume successfully. Sep 28 17:22:45 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.720s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:45 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:45 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] Deleted volume successfully. Sep 28 17:22:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-edccb574-8b7c-4d42-892a-cfcaf23329dd tempest-CreateVolumesFromImageTest-734638435 None] Lock "cinder-cfaafb98-5405-4fa8-8714-ae81520a65b7-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Acquiring lock "cinder-e01e8971-9d4c-4afa-97e1-0169a7e8fec5-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Lock "cinder-e01e8971-9d4c-4afa-97e1-0169a7e8fec5-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:46 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Acquiring lock "cinder-quobyte-e01e8971-9d4c-4afa-97e1-0169a7e8fec5" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e2845e5d-087b-487c-bb3b-4480196bc13e" returned: 0 in 0.881s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Lock "cinder-quobyte-e01e8971-9d4c-4afa-97e1-0169a7e8fec5" acquired by "delete_volume" :: waited 0.035s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] Lock "cinder-quobyte-e2845e5d-087b-487c-bb3b-4480196bc13e" released by "delete_volume" :: held 2.020s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:46 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[107fe1ec-6dcf-45cb-9d00-99a4f825f5d0]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:46 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] Created reservations ['4879832f-c264-4359-b889-fc01242ecac3', 'c51f6a2a-eaef-45cc-ba63-c04585df684d', '5857bb99-6c3d-4828-a48e-1c269077676d', '5f316939-2367-4bc8-b96c-dff8d0813339'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:46 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5 Sep 28 17:22:46 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:46 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:46 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:46 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:22:46 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:47 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5" returned: 0 in 0.865s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:47 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5 Sep 28 17:22:47 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:47 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.748s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:47 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:47 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] Deleted volume successfully. Sep 28 17:22:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-90d397ce-054e-4750-a330-a77fba471341 tempest-VolumeImageDependencyTests-824515101 None] Lock "cinder-e2845e5d-087b-487c-bb3b-4480196bc13e-delete_volume" released by "delete_volume" :: held 3.474s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:47 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e01e8971-9d4c-4afa-97e1-0169a7e8fec5" returned: 0 in 0.639s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Lock "cinder-quobyte-e01e8971-9d4c-4afa-97e1-0169a7e8fec5" released by "delete_volume" :: held 1.634s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:47 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Created reservations ['6dc32616-a29b-4f84-acff-9f96d17e9140', '7eecab41-c4a7-4164-b976-fd601a6cc875', '4d22e280-2345-4f6c-882b-341a054ee7ed', 'bdc4f778-0655-436a-b01e-4e8d8646d241'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:47 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:48 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:48 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:22:48 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:48 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.547s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:48 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:48 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Deleted volume successfully. Sep 28 17:22:48 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-15cbd447-ffad-4eab-9dbf-96af62f45015 tempest-VolumeAndVolumeTypeFromImageTest-1894951262 None] Lock "cinder-e01e8971-9d4c-4afa-97e1-0169a7e8fec5-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:51 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495" returned: 0 in 9.584s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:51 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Image conversion details: src /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5, size 1024.00 MB, duration 9.58 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495 {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:22:51 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Converted 1024.00 MB image at 106.84 MB/s Sep 28 17:22:51 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495 is being set with open permissions: ugo+rw Sep 28 17:22:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:51 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495 Sep 28 17:22:51 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:51 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495" returned: 0 in 0.382s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:51 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Lock "cinder-quobyte-bc85bba1-5dfd-4ae4-befa-4aebf02cd495" released by "_copy_volume_from_snapshot" :: held 11.193s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:51 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Lock "cinder-quobyte-47a1dcea-80da-44e5-a9fe-2e68cb9af804-bc85bba1-5dfd-4ae4-befa-4aebf02cd495" released by "_create_volume_from_snapshot" :: held 11.314s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.344s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d991804e-e1f3-4ee7-a643-235be76cd50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495', 'volume_size': 1, 'snapshot_id': '47a1dcea-80da-44e5-a9fe-2e68cb9af804'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ded19c-926b-4ffe-a792-40ea2ac3e98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:52 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Volume volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495 (bc85bba1-5dfd-4ae4-befa-4aebf02cd495): created successfully Sep 28 17:22:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ded19c-926b-4ffe-a792-40ea2ac3e98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:52 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Flow 'volume_create_manager' (8439a6d3-ac04-470d-a667-a6ea6ac7dffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:52 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-80727197-b757-4fe8-a0cf-74f16e8a28b1 tempest-VolumeDependencyTests-622274781 None] Created volume successfully. Sep 28 17:22:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] Acquiring lock "cinder-47a1dcea-80da-44e5-a9fe-2e68cb9af804-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] Lock "cinder-47a1dcea-80da-44e5-a9fe-2e68cb9af804-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] Acquiring lock "cinder-quobyte-20e13196-3b4b-4199-80b3-47a5b050e0e5" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] Lock "cinder-quobyte-20e13196-3b4b-4199-80b3-47a5b050e0e5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] Acquiring lock "cinder-quobyte-47a1dcea-80da-44e5-a9fe-2e68cb9af804" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] Lock "cinder-quobyte-47a1dcea-80da-44e5-a9fe-2e68cb9af804" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] Deleting offline snapshot 47a1dcea-80da-44e5-a9fe-2e68cb9af804 of volume 20e13196-3b4b-4199-80b3-47a5b050e0e5 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:22:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] snapshot_file for this snap is: volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:22:52 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[62941086-b497-4a0f-a785-100fa88fbf2c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:52 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804 Sep 28 17:22:52 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:52 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804" returned: 0 in 0.628s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20e13196-3b4b-4199-80b3-47a5b050e0e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[811ed2a0-ff0e-4387-9f6b-ed9e4ae30994]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:53 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 Sep 28 17:22:53 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Flow 'volume_create_manager' (40e1e454-ab94-4f15-b318-4b0ac4001973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f842ab-e46a-4389-8be4-0569dbfcffaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f842ab-e46a-4389-8be4-0569dbfcffaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1774329576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60291a58-6bc3-4b2f-be67-7ed1dc71cef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7580f78099e74ec09772f10c229fa658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:53Z,use_quota=True,user_id='408ceb030f0946ca91ed516a7246b79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a31313-2558-455b-87e3-ed5d707f9e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a31313-2558-455b-87e3-ed5d707f9e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc30823d-c6e1-4653-a81e-c9bd9197cd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc30823d-c6e1-4653-a81e-c9bd9197cd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60291a58-6bc3-4b2f-be67-7ed1dc71cef6', 'volume_name': 'volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca05d677-0278-4e7e-8c29-399555ce39dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca05d677-0278-4e7e-8c29-399555ce39dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a577b3b0-b48f-4b37-85a8-e88716ec7697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:53 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume 60291a58-6bc3-4b2f-be67-7ed1dc71cef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6', 'volume_size': 1} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1774329576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60291a58-6bc3-4b2f-be67-7ed1dc71cef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7580f78099e74ec09772f10c229fa658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:53Z,use_quota=True,user_id='408ceb030f0946ca91ed516a7246b79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Creating volume 60291a58-6bc3-4b2f-be67-7ed1dc71cef6 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:53 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:22:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:53 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6 1073741824 Sep 28 17:22:53 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:54 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5" returned: 0 in 0.928s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:54 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804 Sep 28 17:22:54 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Flow 'volume_create_manager' (192ce8d2-e913-465d-8c61-85afe18e5fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bfe7b4a-471b-4be3-90f2-b5e91793cf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bfe7b4a-471b-4be3-90f2-b5e91793cf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476ab9f7-29e3-413a-a450-eaf432f36e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d98476386834d29897ca6d5060a2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:54Z,use_quota=True,user_id='601a6389940a459f91b0c8eb629be442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2119ad-fa82-4095-9b6c-fd893e098996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2119ad-fa82-4095-9b6c-fd893e098996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737ea122-f1dc-49f3-9c20-f0c26620df25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737ea122-f1dc-49f3-9c20-f0c26620df25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '476ab9f7-29e3-413a-a450-eaf432f36e08', 'volume_name': 'volume-476ab9f7-29e3-413a-a450-eaf432f36e08', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2172c17-0aef-479e-a858-44c2b5260c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2172c17-0aef-479e-a858-44c2b5260c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c736eb82-0367-48b2-9952-4b9a1b6ea896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:54 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Volume 476ab9f7-29e3-413a-a450-eaf432f36e08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-476ab9f7-29e3-413a-a450-eaf432f36e08', 'volume_size': 1} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:54 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6 1073741824" returned: 0 in 0.852s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:54 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6 Sep 28 17:22:54 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:54 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804" returned: 0 in 0.552s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:54 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804 Sep 28 17:22:54 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:54 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6" returned: 0 in 0.357s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.609s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476ab9f7-29e3-413a-a450-eaf432f36e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d98476386834d29897ca6d5060a2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:54Z,use_quota=True,user_id='601a6389940a459f91b0c8eb629be442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Creating volume 476ab9f7-29e3-413a-a450-eaf432f36e08 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:54 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:22:54 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-476ab9f7-29e3-413a-a450-eaf432f36e08 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5.47a1dcea-80da-44e5-a9fe-2e68cb9af804" returned: 0 in 0.323s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:54 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-476ab9f7-29e3-413a-a450-eaf432f36e08 1073741824 Sep 28 17:22:54 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a577b3b0-b48f-4b37-85a8-e88716ec7697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06c2336e-d4fd-4ead-8551-3dd9917f92de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:54 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6 (60291a58-6bc3-4b2f-be67-7ed1dc71cef6): created successfully Sep 28 17:22:54 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06c2336e-d4fd-4ead-8551-3dd9917f92de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Flow 'volume_create_manager' (40e1e454-ab94-4f15-b318-4b0ac4001973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] Lock "cinder-quobyte-47a1dcea-80da-44e5-a9fe-2e68cb9af804" released by "_delete_snapshot" :: held 2.704s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] Lock "cinder-quobyte-20e13196-3b4b-4199-80b3-47a5b050e0e5" released by "delete_snapshot" :: held 2.742s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:55 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2e4c2337-b741-4bc1-8cec-196426e17989 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Created volume successfully. Sep 28 17:22:55 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] Created reservations ['a67578b2-a1a5-4740-8259-d7c0276fc7d8', '78c730ab-90b3-436a-b960-dc91a53058e4', '165d4814-c9b3-4199-84f1-33c0d1602490', '55d555f9-79cd-451f-9619-354b286b50f8'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:55 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] Delete snapshot completed successfully. Sep 28 17:22:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-78d0ced5-097b-4bee-8676-2b2bfd0b49c5 tempest-VolumeDependencyTests-622274781 None] Lock "cinder-47a1dcea-80da-44e5-a9fe-2e68cb9af804-delete_snapshot" released by "delete_snapshot" :: held 2.940s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:55 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-476ab9f7-29e3-413a-a450-eaf432f36e08 1073741824" returned: 0 in 0.698s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] Acquiring lock "cinder-20e13196-3b4b-4199-80b3-47a5b050e0e5-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] Lock "cinder-20e13196-3b4b-4199-80b3-47a5b050e0e5-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-476ab9f7-29e3-413a-a450-eaf432f36e08 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:55 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-476ab9f7-29e3-413a-a450-eaf432f36e08 Sep 28 17:22:55 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] Acquiring lock "cinder-quobyte-20e13196-3b4b-4199-80b3-47a5b050e0e5" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] Lock "cinder-quobyte-20e13196-3b4b-4199-80b3-47a5b050e0e5" acquired by "delete_volume" :: waited 0.018s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:55 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7887d1-06ae-469a-b86e-9003fabfcf48]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:55 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 Sep 28 17:22:55 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:56 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-476ab9f7-29e3-413a-a450-eaf432f36e08" returned: 0 in 0.348s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.179s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c736eb82-0367-48b2-9952-4b9a1b6ea896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-476ab9f7-29e3-413a-a450-eaf432f36e08', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9400cd5a-ce1d-44af-869e-087711e5c539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Creating offline snapshot a8691e6d-4297-4836-a0ea-0e7f7591bbef of volume 60291a58-6bc3-4b2f-be67-7ed1dc71cef6 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:22:56 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Volume volume-476ab9f7-29e3-413a-a450-eaf432f36e08 (476ab9f7-29e3-413a-a450-eaf432f36e08): created successfully Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9400cd5a-ce1d-44af-869e-087711e5c539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Flow 'volume_create_manager' (192ce8d2-e913-465d-8c61-85afe18e5fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71aa00c-e6c6-4998-9e59-6b603f5057e5]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:56 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-37e5ac89-4bb4-43dd-b18d-864169612da8 tempest-CinderUnicodeTest-1959528220 None] Created volume successfully. Sep 28 17:22:56 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6 Sep 28 17:22:56 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:56 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5" returned: 0 in 0.489s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:56 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5 Sep 28 17:22:56 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:56 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6" returned: 0 in 0.502s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:56 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef 1G Sep 28 17:22:56 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:56 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Flow 'volume_create_manager' (0be595df-f075-4fb6-83b4-550bb17df1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afdbc71d-ac42-464d-a37d-2e79b2d50c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-20e13196-3b4b-4199-80b3-47a5b050e0e5" returned: 0 in 0.360s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afdbc71d-ac42-464d-a37d-2e79b2d50c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1692823091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07017509-6e09-4612-9e6b-423836f646b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e82783727f44732959be8d72f2f924e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:57Z,use_quota=True,user_id='f249f1c288d64940af51a3184e01d4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d857bdf6-e16e-41de-bcb8-0f37a27fae5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d857bdf6-e16e-41de-bcb8-0f37a27fae5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79464270-f9c7-49ac-9558-1d37e12c2a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79464270-f9c7-49ac-9558-1d37e12c2a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07017509-6e09-4612-9e6b-423836f646b9', 'volume_name': 'volume-07017509-6e09-4612-9e6b-423836f646b9', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed865d25-da0b-499a-bceb-f828148f541d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed865d25-da0b-499a-bceb-f828148f541d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51dcb80d-9ff2-4b74-a237-1483a6dc433e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:56 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume 07017509-6e09-4612-9e6b-423836f646b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07017509-6e09-4612-9e6b-423836f646b9', 'volume_size': 1} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] Lock "cinder-quobyte-20e13196-3b4b-4199-80b3-47a5b050e0e5" released by "delete_volume" :: held 1.009s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] Created reservations ['7993e23b-03d7-4fa2-b737-a87b38956e69', '310f3057-a600-43bc-991c-0ec7a2b62f79', 'e232d855-5834-480b-b1c9-e0de846dc7b3', '8ea4e6a9-349a-4c9e-8457-68fb216e59e6'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:56 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:22:56 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:57 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef 1G" returned: 0 in 0.454s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:57 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef Sep 28 17:22:57 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:57 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.301s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:57 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:57 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] Deleted volume successfully. Sep 28 17:22:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-e7a6f559-a2a1-4f7e-8dde-f83f69460bed tempest-VolumeDependencyTests-622274781 None] Lock "cinder-20e13196-3b4b-4199-80b3-47a5b050e0e5-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:57 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef" returned: 0 in 0.343s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:57 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef is being set with open permissions: ugo+rw Sep 28 17:22:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:57 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef Sep 28 17:22:57 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:57 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef" returned: 0 in 0.294s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:57 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.info Sep 28 17:22:57 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] Acquiring lock "cinder-bc85bba1-5dfd-4ae4-befa-4aebf02cd495-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:57 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Flow 'volume_create_manager' (a8d346ac-1eb7-4653-802a-4dc4e2779345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f470ff6c-1e11-463a-a34e-33bc87cd0ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] Lock "cinder-bc85bba1-5dfd-4ae4-befa-4aebf02cd495-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f470ff6c-1e11-463a-a34e-33bc87cd0ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1583620633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46706549-ebec-4a51-9ac1-0db7f6f1ed61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d98476386834d29897ca6d5060a2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:58Z,use_quota=True,user_id='601a6389940a459f91b0c8eb629be442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32529cfa-38a0-49cc-ac85-73079bef2b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32529cfa-38a0-49cc-ac85-73079bef2b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bb7069-c9d5-408f-b178-e6ccc07665b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bb7069-c9d5-408f-b178-e6ccc07665b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46706549-ebec-4a51-9ac1-0db7f6f1ed61', 'volume_name': 'volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce229b1b-a325-49ba-aea3-e7c1bd0eeff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce229b1b-a325-49ba-aea3-e7c1bd0eeff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:58 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfd58c6-d70e-4bb0-81e3-784cfec5edd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:58 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Volume 46706549-ebec-4a51-9ac1-0db7f6f1ed61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61', 'volume_size': 1} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.info" returned: 0 in 0.352s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:58 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.info is being set with open permissions: ugo+rw Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:58 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.info Sep 28 17:22:58 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] Acquiring lock "cinder-quobyte-bc85bba1-5dfd-4ae4-befa-4aebf02cd495" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] Lock "cinder-quobyte-bc85bba1-5dfd-4ae4-befa-4aebf02cd495" acquired by "delete_volume" :: waited 0.018s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0010bb-11f3-417e-9ddc-0937f7d912bd]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:58 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495 Sep 28 17:22:58 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:58 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.info" returned: 0 in 0.309s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.413s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.697s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1692823091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07017509-6e09-4612-9e6b-423836f646b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e82783727f44732959be8d72f2f924e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:57Z,use_quota=True,user_id='f249f1c288d64940af51a3184e01d4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Creating volume 07017509-6e09-4612-9e6b-423836f646b9 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:58 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-07017509-6e09-4612-9e6b-423836f646b9 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:58 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-07017509-6e09-4612-9e6b-423836f646b9 1073741824 Sep 28 17:22:58 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:58 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-e65de121-8588-4c19-95b1-131afdcf6925 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Create snapshot completed successfully Sep 28 17:22:58 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495" returned: 0 in 0.472s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:58 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495 Sep 28 17:22:58 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:58 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-bc85bba1-5dfd-4ae4-befa-4aebf02cd495" returned: 0 in 0.322s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] Lock "cinder-quobyte-bc85bba1-5dfd-4ae4-befa-4aebf02cd495" released by "delete_volume" :: held 0.861s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:59 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-07017509-6e09-4612-9e6b-423836f646b9 1073741824" returned: 0 in 0.621s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] Created reservations ['7149f71a-aa7d-4d38-ad37-b3c3a44038ed', 'af09fd48-5be9-4fe5-bb22-3a930fa08aca', '6e15c357-8423-450c-b0a4-d9b925230a49', 'c8023ed3-0828-422b-a1c4-b2c6dbf08caf'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-07017509-6e09-4612-9e6b-423836f646b9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:59 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-07017509-6e09-4612-9e6b-423836f646b9 Sep 28 17:22:59 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:59 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:22:59 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:59 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-07017509-6e09-4612-9e6b-423836f646b9" returned: 0 in 0.333s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.390s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1583620633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46706549-ebec-4a51-9ac1-0db7f6f1ed61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d98476386834d29897ca6d5060a2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:58Z,use_quota=True,user_id='601a6389940a459f91b0c8eb629be442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Creating volume 46706549-ebec-4a51-9ac1-0db7f6f1ed61 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:59 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51dcb80d-9ff2-4b74-a237-1483a6dc433e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07017509-6e09-4612-9e6b-423836f646b9', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0360e1f-b204-4258-ad85-5436bff0bdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:59 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61 1073741824 Sep 28 17:22:59 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:59 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume volume-07017509-6e09-4612-9e6b-423836f646b9 (07017509-6e09-4612-9e6b-423836f646b9): created successfully Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0360e1f-b204-4258-ad85-5436bff0bdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Flow 'volume_create_manager' (0be595df-f075-4fb6-83b4-550bb17df1f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:59 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-f3726b8c-89e0-44e5-b22b-bab3186decdc tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Created volume successfully. Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:59 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Flow 'volume_create_manager' (c6a6431c-28cf-4097-91a2-7e397077bbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b645a137-4960-4438-b9b4-e5cf787f34c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.428s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:59 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] Deleted volume successfully. Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b645a137-4960-4438-b9b4-e5cf787f34c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-950571898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280ec51b-eba1-4015-94ed-57f825c1ccfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7580f78099e74ec09772f10c229fa658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:00Z,use_quota=True,user_id='408ceb030f0946ca91ed516a7246b79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b363b06-c203-4552-b8a1-4328c52d53c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b363b06-c203-4552-b8a1-4328c52d53c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7103d2e-00b2-4b16-947b-b970a7de9dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7103d2e-00b2-4b16-947b-b970a7de9dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '280ec51b-eba1-4015-94ed-57f825c1ccfe', 'volume_name': 'volume-280ec51b-eba1-4015-94ed-57f825c1ccfe', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c2387f-3ed6-4f85-9cf9-dced240b0edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c2387f-3ed6-4f85-9cf9-dced240b0edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f59d902-be6f-47d5-8d96-eece8ddcbf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:59 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume 280ec51b-eba1-4015-94ed-57f825c1ccfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-280ec51b-eba1-4015-94ed-57f825c1ccfe', 'volume_size': 1} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:59 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d0587bb1-bddb-441b-a592-64c587419a57 tempest-VolumeDependencyTests-622274781 None] Lock "cinder-bc85bba1-5dfd-4ae4-befa-4aebf02cd495-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Flow 'volume_create_manager' (500aa4b6-d9a0-4878-bb4c-cf59f9d02362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef61c5bd-2221-412d-be47-47bbe2bf2ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef61c5bd-2221-412d-be47-47bbe2bf2ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1839878351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe4c639-ed87-497f-9bb5-ae27d31c336b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7580f78099e74ec09772f10c229fa658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:00Z,use_quota=True,user_id='408ceb030f0946ca91ed516a7246b79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e55f411-9882-475b-86ab-50ff9663ef2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e55f411-9882-475b-86ab-50ff9663ef2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432aa218-85f0-4f8a-99d8-8855fc378d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432aa218-85f0-4f8a-99d8-8855fc378d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe4c639-ed87-497f-9bb5-ae27d31c336b', 'volume_name': 'volume-cfe4c639-ed87-497f-9bb5-ae27d31c336b', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d05fcb8-07ad-43a1-91f9-8b1fda444298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:00 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d05fcb8-07ad-43a1-91f9-8b1fda444298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9fe18e-a69a-4fab-87d6-1f1bcfc14aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:00 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume cfe4c639-ed87-497f-9bb5-ae27d31c336b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe4c639-ed87-497f-9bb5-ae27d31c336b', 'volume_size': 1} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61 1073741824" returned: 0 in 0.757s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:00 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61 Sep 28 17:23:00 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:00 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61" returned: 0 in 0.465s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.034s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-950571898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280ec51b-eba1-4015-94ed-57f825c1ccfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7580f78099e74ec09772f10c229fa658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:00Z,use_quota=True,user_id='408ceb030f0946ca91ed516a7246b79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Creating volume 280ec51b-eba1-4015-94ed-57f825c1ccfe {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:00 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-280ec51b-eba1-4015-94ed-57f825c1ccfe 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:00 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-280ec51b-eba1-4015-94ed-57f825c1ccfe 1073741824 Sep 28 17:23:00 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfd58c6-d70e-4bb0-81e3-784cfec5edd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40c27e1-dd16-4961-b7b4-e720ee98f1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:00 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Flow 'volume_create_manager' (7740e77c-b892-46f3-880a-44885bc4f1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2b2992-696d-4df6-bdd3-7b8d09cd23e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Volume volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61 (46706549-ebec-4a51-9ac1-0db7f6f1ed61): created successfully Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40c27e1-dd16-4961-b7b4-e720ee98f1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Flow 'volume_create_manager' (a8d346ac-1eb7-4653-802a-4dc4e2779345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2b2992-696d-4df6-bdd3-7b8d09cd23e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-126668237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ab708f-9a76-4fa1-920f-340a4887798f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e82783727f44732959be8d72f2f924e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:01Z,use_quota=True,user_id='f249f1c288d64940af51a3184e01d4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d85e0f-558b-4997-a5b7-b085686c55f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d85e0f-558b-4997-a5b7-b085686c55f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba1ef02-f11b-4f42-8660-08ec596bf256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba1ef02-f11b-4f42-8660-08ec596bf256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52ab708f-9a76-4fa1-920f-340a4887798f', 'volume_name': 'volume-52ab708f-9a76-4fa1-920f-340a4887798f', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6379ebaf-55cc-42be-9069-63d9dce8dda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6379ebaf-55cc-42be-9069-63d9dce8dda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514f25ef-ae22-4553-9514-055f9db017f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume 52ab708f-9a76-4fa1-920f-340a4887798f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52ab708f-9a76-4fa1-920f-340a4887798f', 'volume_size': 1} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:01 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-01dd585f-09c2-4b38-b81c-66952d9668a6 tempest-CinderUnicodeTest-1959528220 None] Created volume successfully. Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:01 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:01 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Flow 'volume_create_manager' (faa8b7e1-a661-4b7b-b76f-e056326f106a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d0f2b5-7156-4030-82ca-9a749ad49119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d0f2b5-7156-4030-82ca-9a749ad49119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1298580728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7580f78099e74ec09772f10c229fa658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:01Z,use_quota=True,user_id='408ceb030f0946ca91ed516a7246b79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afb4b80-ef49-48df-bf3e-7cc62a617a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afb4b80-ef49-48df-bf3e-7cc62a617a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62147040-bdbe-4d4c-a486-9c8f883c7fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62147040-bdbe-4d4c-a486-9c8f883c7fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8', 'volume_name': 'volume-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2eff51-b6f8-4753-894e-7210a1a5056a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2eff51-b6f8-4753-894e-7210a1a5056a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad03d4c-4aea-4b8d-a3bd-603b0ffef563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume 98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8', 'volume_size': 1} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Flow 'volume_create_manager' (b4d8f279-9914-4fa4-96b2-52e1dc321263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04079d51-bef8-489d-aac1-be8a3a0ac4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04079d51-bef8-489d-aac1-be8a3a0ac4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-686166101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6208a979-42df-41ce-bcd2-a66051fb2676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e82783727f44732959be8d72f2f924e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:01Z,use_quota=True,user_id='f249f1c288d64940af51a3184e01d4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa374ba2-8eb3-482b-ba0a-17ef6eeccd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa374ba2-8eb3-482b-ba0a-17ef6eeccd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0cae42-04a7-4088-8eec-5c8abf05450e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0cae42-04a7-4088-8eec-5c8abf05450e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6208a979-42df-41ce-bcd2-a66051fb2676', 'volume_name': 'volume-6208a979-42df-41ce-bcd2-a66051fb2676', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a59cff-04bb-490b-82e7-9298119e15b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a59cff-04bb-490b-82e7-9298119e15b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d832aba-771f-499e-898c-17205b272414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume 6208a979-42df-41ce-bcd2-a66051fb2676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6208a979-42df-41ce-bcd2-a66051fb2676', 'volume_size': 1} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.613s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-280ec51b-eba1-4015-94ed-57f825c1ccfe 1073741824" returned: 0 in 0.979s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:23:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-280ec51b-eba1-4015-94ed-57f825c1ccfe {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:01 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-280ec51b-eba1-4015-94ed-57f825c1ccfe Sep 28 17:23:01 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:02 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-280ec51b-eba1-4015-94ed-57f825c1ccfe" returned: 0 in 0.413s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1839878351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe4c639-ed87-497f-9bb5-ae27d31c336b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7580f78099e74ec09772f10c229fa658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:00Z,use_quota=True,user_id='408ceb030f0946ca91ed516a7246b79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Creating volume cfe4c639-ed87-497f-9bb5-ae27d31c336b {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:02 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfe4c639-ed87-497f-9bb5-ae27d31c336b 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f59d902-be6f-47d5-8d96-eece8ddcbf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-280ec51b-eba1-4015-94ed-57f825c1ccfe', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:02 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfe4c639-ed87-497f-9bb5-ae27d31c336b 1073741824 Sep 28 17:23:02 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a5a3d5-8a14-444e-ad06-1668d3d9405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Flow 'volume_create_manager' (89bb66be-d863-41be-bebb-12918e5bb52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70545f5-5171-4025-8405-1c4436a074db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70545f5-5171-4025-8405-1c4436a074db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1588389906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea539f4-9b9d-4f9c-9605-e59f8773c801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7580f78099e74ec09772f10c229fa658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:02Z,use_quota=True,user_id='408ceb030f0946ca91ed516a7246b79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a79695-8601-492c-8838-4a744fb6776a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a79695-8601-492c-8838-4a744fb6776a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17946c4-8d26-4003-a24f-4f4766c177fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17946c4-8d26-4003-a24f-4f4766c177fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ea539f4-9b9d-4f9c-9605-e59f8773c801', 'volume_name': 'volume-5ea539f4-9b9d-4f9c-9605-e59f8773c801', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49838ea-e711-4abd-bb1e-aef74390465a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49838ea-e711-4abd-bb1e-aef74390465a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f9c67b2-b211-4b95-b20d-18526ad1cd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:02 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume 5ea539f4-9b9d-4f9c-9605-e59f8773c801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ea539f4-9b9d-4f9c-9605-e59f8773c801', 'volume_size': 1} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:02 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume volume-280ec51b-eba1-4015-94ed-57f825c1ccfe (280ec51b-eba1-4015-94ed-57f825c1ccfe): created successfully Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a5a3d5-8a14-444e-ad06-1668d3d9405b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:02 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Flow 'volume_create_manager' (c6a6431c-28cf-4097-91a2-7e397077bbf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:02 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-860bc309-2de0-4b77-87d9-078bd4687a27 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Created volume successfully. Sep 28 17:23:03 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfe4c639-ed87-497f-9bb5-ae27d31c336b 1073741824" returned: 0 in 0.914s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfe4c639-ed87-497f-9bb5-ae27d31c336b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:03 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfe4c639-ed87-497f-9bb5-ae27d31c336b Sep 28 17:23:03 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Flow 'volume_create_manager' (d8be6d39-a8eb-4e06-b24e-93691c99b791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56a8ae2-9e35-43f1-a8f2-8908b0ebb67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56a8ae2-9e35-43f1-a8f2-8908b0ebb67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556679809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c58b2fd-bc3d-4c73-892d-9c6f836cea41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e82783727f44732959be8d72f2f924e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:03Z,use_quota=True,user_id='f249f1c288d64940af51a3184e01d4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4558790a-3329-49a4-885e-327c9e556b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4558790a-3329-49a4-885e-327c9e556b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b769ae69-b159-4d90-ad8d-7426c33a6347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b769ae69-b159-4d90-ad8d-7426c33a6347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c58b2fd-bc3d-4c73-892d-9c6f836cea41', 'volume_name': 'volume-2c58b2fd-bc3d-4c73-892d-9c6f836cea41', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f55d946-5bbf-434f-a53e-a5b154215e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f55d946-5bbf-434f-a53e-a5b154215e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4202df1-6370-44f8-ba7b-970453931618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:03 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume 2c58b2fd-bc3d-4c73-892d-9c6f836cea41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c58b2fd-bc3d-4c73-892d-9c6f836cea41', 'volume_size': 1} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Flow 'volume_create_manager' (34691736-c69d-4cc8-b599-bff4e4a12cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2d0c8a-b896-45e2-a06f-26d2f836ad64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfe4c639-ed87-497f-9bb5-ae27d31c336b" returned: 0 in 0.509s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.640s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-126668237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ab708f-9a76-4fa1-920f-340a4887798f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e82783727f44732959be8d72f2f924e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:01Z,use_quota=True,user_id='f249f1c288d64940af51a3184e01d4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Creating volume 52ab708f-9a76-4fa1-920f-340a4887798f {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:03 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52ab708f-9a76-4fa1-920f-340a4887798f 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2d0c8a-b896-45e2-a06f-26d2f836ad64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-629507190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=432239f3-17ad-4314-92af-261ddbee367f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e82783727f44732959be8d72f2f924e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:03Z,use_quota=True,user_id='f249f1c288d64940af51a3184e01d4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3392ca04-3e54-44e4-9ba2-5c74b4b01362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52ab708f-9a76-4fa1-920f-340a4887798f 1073741824 Sep 28 17:23:03 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3392ca04-3e54-44e4-9ba2-5c74b4b01362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b5d0a5-b38e-4f18-82f5-669d819c2d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b5d0a5-b38e-4f18-82f5-669d819c2d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '432239f3-17ad-4314-92af-261ddbee367f', 'volume_name': 'volume-432239f3-17ad-4314-92af-261ddbee367f', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d4a014-e049-4ec3-b459-580ea2c08470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d4a014-e049-4ec3-b459-580ea2c08470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3274028d-1e9d-46dc-90bf-671c559a5ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume 432239f3-17ad-4314-92af-261ddbee367f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-432239f3-17ad-4314-92af-261ddbee367f', 'volume_size': 1} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9fe18e-a69a-4fab-87d6-1f1bcfc14aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe4c639-ed87-497f-9bb5-ae27d31c336b', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef37fa6-a60a-4111-b34c-e8cb44c9c2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Flow 'volume_create_manager' (60f6adfa-d383-4523-abfc-050bfd43d59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6bff6b0-5e34-4c0a-8bb1-a280e46c5cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume volume-cfe4c639-ed87-497f-9bb5-ae27d31c336b (cfe4c639-ed87-497f-9bb5-ae27d31c336b): created successfully Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef37fa6-a60a-4111-b34c-e8cb44c9c2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Flow 'volume_create_manager' (500aa4b6-d9a0-4878-bb4c-cf59f9d02362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Flow 'volume_create_manager' (36a92c06-f585-4061-86e6-67fb059fa394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfa4602-0b5e-48af-8c5d-8fdfd4640376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6bff6b0-5e34-4c0a-8bb1-a280e46c5cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-891161919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d1d389-8e13-40ee-9114-f248b3cbfd79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7580f78099e74ec09772f10c229fa658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:04Z,use_quota=True,user_id='408ceb030f0946ca91ed516a7246b79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c39bef-29dd-4d4a-adf4-389329704d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c39bef-29dd-4d4a-adf4-389329704d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb4ad9e-4701-4c85-a406-c227c6728d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb4ad9e-4701-4c85-a406-c227c6728d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d1d389-8e13-40ee-9114-f248b3cbfd79', 'volume_name': 'volume-57d1d389-8e13-40ee-9114-f248b3cbfd79', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024de246-ac35-4fab-a01e-3eb8fdaa3833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024de246-ac35-4fab-a01e-3eb8fdaa3833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fdb7460-64c6-47e8-8882-1a2117651f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume 57d1d389-8e13-40ee-9114-f248b3cbfd79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d1d389-8e13-40ee-9114-f248b3cbfd79', 'volume_size': 1} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:04 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-575f461e-4f68-4246-a35e-58670507fae1 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Created volume successfully. Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfa4602-0b5e-48af-8c5d-8fdfd4640376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1583878946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e82783727f44732959be8d72f2f924e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:04Z,use_quota=True,user_id='f249f1c288d64940af51a3184e01d4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed95dfa9-a34f-4743-a26d-98c1ea825e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed95dfa9-a34f-4743-a26d-98c1ea825e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40e99d6-0f58-46b8-a02a-8a332bf8efe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40e99d6-0f58-46b8-a02a-8a332bf8efe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb', 'volume_name': 'volume-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36977a6a-3488-4dc9-ac02-b20d80a382a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36977a6a-3488-4dc9-ac02-b20d80a382a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302738fa-0fd1-4d20-a8b2-03f60cf8dc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume 15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb', 'volume_size': 1} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:04 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52ab708f-9a76-4fa1-920f-340a4887798f 1073741824" returned: 0 in 0.745s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52ab708f-9a76-4fa1-920f-340a4887798f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:04 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52ab708f-9a76-4fa1-920f-340a4887798f Sep 28 17:23:04 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:04 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52ab708f-9a76-4fa1-920f-340a4887798f" returned: 0 in 0.325s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.626s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1298580728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7580f78099e74ec09772f10c229fa658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:01Z,use_quota=True,user_id='408ceb030f0946ca91ed516a7246b79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Creating volume 98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:04 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514f25ef-ae22-4553-9514-055f9db017f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52ab708f-9a76-4fa1-920f-340a4887798f', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8 1073741824 Sep 28 17:23:04 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d31391-919c-4dd5-85fd-8a3b57711fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume volume-52ab708f-9a76-4fa1-920f-340a4887798f (52ab708f-9a76-4fa1-920f-340a4887798f): created successfully Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d31391-919c-4dd5-85fd-8a3b57711fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Flow 'volume_create_manager' (7740e77c-b892-46f3-880a-44885bc4f1aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:05 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-5c0f26fb-8383-4116-a20a-e4fe8eac66bf tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Created volume successfully. Sep 28 17:23:05 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8 1073741824" returned: 0 in 0.541s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:05 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8 Sep 28 17:23:05 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:05 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8" returned: 0 in 0.279s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.059s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-686166101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6208a979-42df-41ce-bcd2-a66051fb2676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e82783727f44732959be8d72f2f924e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:01Z,use_quota=True,user_id='f249f1c288d64940af51a3184e01d4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Creating volume 6208a979-42df-41ce-bcd2-a66051fb2676 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:05 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6208a979-42df-41ce-bcd2-a66051fb2676 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad03d4c-4aea-4b8d-a3bd-603b0ffef563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b04aa0-8702-4fec-97e0-f3b561523c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6208a979-42df-41ce-bcd2-a66051fb2676 1073741824 Sep 28 17:23:05 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:05 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume volume-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8 (98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8): created successfully Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b04aa0-8702-4fec-97e0-f3b561523c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:05 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Flow 'volume_create_manager' (faa8b7e1-a661-4b7b-b76f-e056326f106a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:05 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-71a9909d-8a72-4ded-afb9-beb5a05fdacd tempest-CreateVolumesFromSnapshotTest-1298566375 None] Created volume successfully. Sep 28 17:23:06 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6208a979-42df-41ce-bcd2-a66051fb2676 1073741824" returned: 0 in 0.562s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6208a979-42df-41ce-bcd2-a66051fb2676 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:06 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6208a979-42df-41ce-bcd2-a66051fb2676 Sep 28 17:23:06 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:06 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6208a979-42df-41ce-bcd2-a66051fb2676" returned: 0 in 0.329s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.212s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1588389906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea539f4-9b9d-4f9c-9605-e59f8773c801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7580f78099e74ec09772f10c229fa658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:02Z,use_quota=True,user_id='408ceb030f0946ca91ed516a7246b79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Creating volume 5ea539f4-9b9d-4f9c-9605-e59f8773c801 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:06 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5ea539f4-9b9d-4f9c-9605-e59f8773c801 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:06 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5ea539f4-9b9d-4f9c-9605-e59f8773c801 1073741824 Sep 28 17:23:06 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d832aba-771f-499e-898c-17205b272414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6208a979-42df-41ce-bcd2-a66051fb2676', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0feba7f0-e039-4137-8762-9b149549d5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:06 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume volume-6208a979-42df-41ce-bcd2-a66051fb2676 (6208a979-42df-41ce-bcd2-a66051fb2676): created successfully Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0feba7f0-e039-4137-8762-9b149549d5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Flow 'volume_create_manager' (b4d8f279-9914-4fa4-96b2-52e1dc321263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:06 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-7f76565c-83a4-47b9-9b46-19fcd4fd45d7 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Created volume successfully. Sep 28 17:23:07 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5ea539f4-9b9d-4f9c-9605-e59f8773c801 1073741824" returned: 0 in 0.596s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5ea539f4-9b9d-4f9c-9605-e59f8773c801 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:07 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5ea539f4-9b9d-4f9c-9605-e59f8773c801 Sep 28 17:23:07 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Flow 'volume_create_manager' (41627a07-58e0-4a6e-aecd-a12e717c7070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ac4319-35b0-4730-ab01-7097de713986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ac4319-35b0-4730-ab01-7097de713986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1968530964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0769dc-725a-4d23-a284-20cac0009a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5137d86e24974e68accf0307ba2d89a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:07Z,use_quota=True,user_id='60f9c139ea0d4620b4505a585245fcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489b66fa-5dfe-4d00-80d7-a62cdc259b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489b66fa-5dfe-4d00-80d7-a62cdc259b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41f80e8-de3d-4669-bb08-6cec6c1e6145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41f80e8-de3d-4669-bb08-6cec6c1e6145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c0769dc-725a-4d23-a284-20cac0009a83', 'volume_name': 'volume-2c0769dc-725a-4d23-a284-20cac0009a83', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a448de5-5567-4b50-b0d0-1ab786968a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a448de5-5567-4b50-b0d0-1ab786968a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9d1b94-fa53-4f6a-bb23-53f34d782bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:07 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Volume 2c0769dc-725a-4d23-a284-20cac0009a83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c0769dc-725a-4d23-a284-20cac0009a83', 'volume_size': 1} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:07 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5ea539f4-9b9d-4f9c-9605-e59f8773c801" returned: 0 in 0.306s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.023s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556679809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c58b2fd-bc3d-4c73-892d-9c6f836cea41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e82783727f44732959be8d72f2f924e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:03Z,use_quota=True,user_id='f249f1c288d64940af51a3184e01d4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Creating volume 2c58b2fd-bc3d-4c73-892d-9c6f836cea41 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:07 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c58b2fd-bc3d-4c73-892d-9c6f836cea41 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:07 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c58b2fd-bc3d-4c73-892d-9c6f836cea41 1073741824 Sep 28 17:23:07 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f9c67b2-b211-4b95-b20d-18526ad1cd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ea539f4-9b9d-4f9c-9605-e59f8773c801', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5f2cd8-0a33-4c5e-8792-ea4f3fe41bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:07 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume volume-5ea539f4-9b9d-4f9c-9605-e59f8773c801 (5ea539f4-9b9d-4f9c-9605-e59f8773c801): created successfully Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5f2cd8-0a33-4c5e-8792-ea4f3fe41bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Flow 'volume_create_manager' (89bb66be-d863-41be-bebb-12918e5bb52d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:07 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-cca6f576-23aa-43ac-85ac-bb85b14566b8 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Created volume successfully. Sep 28 17:23:08 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c58b2fd-bc3d-4c73-892d-9c6f836cea41 1073741824" returned: 0 in 0.537s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c58b2fd-bc3d-4c73-892d-9c6f836cea41 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:08 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c58b2fd-bc3d-4c73-892d-9c6f836cea41 Sep 28 17:23:08 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:08 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c58b2fd-bc3d-4c73-892d-9c6f836cea41" returned: 0 in 0.303s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.825s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] Creating offline snapshot f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef of volume 46706549-ebec-4a51-9ac1-0db7f6f1ed61 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:23:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4202df1-6370-44f8-ba7b-970453931618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c58b2fd-bc3d-4c73-892d-9c6f836cea41', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95db826b-3260-411d-afe3-e87825948396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:08 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3280fb99-9fa0-4fc9-bed8-9837a3211fa5]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:08 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume volume-2c58b2fd-bc3d-4c73-892d-9c6f836cea41 (2c58b2fd-bc3d-4c73-892d-9c6f836cea41): created successfully Sep 28 17:23:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95db826b-3260-411d-afe3-e87825948396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Flow 'volume_create_manager' (d8be6d39-a8eb-4e06-b24e-93691c99b791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:08 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0fe77223-e2be-4bcf-ad58-c1279cacbffb tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Created volume successfully. Sep 28 17:23:08 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61 Sep 28 17:23:08 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:09 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61" returned: 0 in 0.437s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:09 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef 1G Sep 28 17:23:09 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:09 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef 1G" returned: 0 in 0.486s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:09 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef Sep 28 17:23:09 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:09 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef" returned: 0 in 0.291s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:09 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef is being set with open permissions: ugo+rw Sep 28 17:23:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:09 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef Sep 28 17:23:09 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:10 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef" returned: 0 in 0.284s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:10 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.info Sep 28 17:23:10 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:10 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.info" returned: 0 in 0.258s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:10 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.info is being set with open permissions: ugo+rw Sep 28 17:23:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:10 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.info Sep 28 17:23:10 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:10 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.info" returned: 0 in 0.272s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.891s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-629507190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=432239f3-17ad-4314-92af-261ddbee367f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e82783727f44732959be8d72f2f924e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:03Z,use_quota=True,user_id='f249f1c288d64940af51a3184e01d4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Creating volume 432239f3-17ad-4314-92af-261ddbee367f {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:10 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-432239f3-17ad-4314-92af-261ddbee367f 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:10 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-432239f3-17ad-4314-92af-261ddbee367f 1073741824 Sep 28 17:23:10 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:10 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-cf986628-f026-4899-88c0-93a819675716 tempest-CinderUnicodeTest-1959528220 None] Create snapshot completed successfully Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] Acquiring lock "cinder-f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] Lock "cinder-f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] Acquiring lock "cinder-quobyte-46706549-ebec-4a51-9ac1-0db7f6f1ed61" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] Lock "cinder-quobyte-46706549-ebec-4a51-9ac1-0db7f6f1ed61" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] Acquiring lock "cinder-quobyte-f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] Lock "cinder-quobyte-f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] Deleting offline snapshot f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef of volume 46706549-ebec-4a51-9ac1-0db7f6f1ed61 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] snapshot_file for this snap is: volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1de490-668a-461b-bb93-e2f1f8dd8a0c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:11 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-432239f3-17ad-4314-92af-261ddbee367f 1073741824" returned: 0 in 0.605s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-432239f3-17ad-4314-92af-261ddbee367f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:11 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-432239f3-17ad-4314-92af-261ddbee367f Sep 28 17:23:11 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:11 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef Sep 28 17:23:11 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:11 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-432239f3-17ad-4314-92af-261ddbee367f" returned: 0 in 0.380s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.666s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-891161919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d1d389-8e13-40ee-9114-f248b3cbfd79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7580f78099e74ec09772f10c229fa658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:04Z,use_quota=True,user_id='408ceb030f0946ca91ed516a7246b79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Creating volume 57d1d389-8e13-40ee-9114-f248b3cbfd79 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:11 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:11 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-57d1d389-8e13-40ee-9114-f248b3cbfd79 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef" returned: 0 in 0.507s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:11 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-57d1d389-8e13-40ee-9114-f248b3cbfd79 1073741824 Sep 28 17:23:11 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3274028d-1e9d-46dc-90bf-671c559a5ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-432239f3-17ad-4314-92af-261ddbee367f', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd9edf7-aafa-43f0-903d-5ddca7ad8e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8f5512-001d-4fed-9258-5440c6d64cca]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:12 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume volume-432239f3-17ad-4314-92af-261ddbee367f (432239f3-17ad-4314-92af-261ddbee367f): created successfully Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd9edf7-aafa-43f0-903d-5ddca7ad8e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Flow 'volume_create_manager' (34691736-c69d-4cc8-b599-bff4e4a12cd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:12 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-abfae6d7-86c3-48b7-a52c-20f9a35daf63 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Created volume successfully. Sep 28 17:23:12 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61 Sep 28 17:23:12 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:12 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-57d1d389-8e13-40ee-9114-f248b3cbfd79 1073741824" returned: 0 in 0.593s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:12 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61" returned: 0 in 0.518s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-57d1d389-8e13-40ee-9114-f248b3cbfd79 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:12 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef Sep 28 17:23:12 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:12 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-57d1d389-8e13-40ee-9114-f248b3cbfd79 Sep 28 17:23:12 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:12 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-57d1d389-8e13-40ee-9114-f248b3cbfd79" returned: 0 in 0.288s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.560s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1583878946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e82783727f44732959be8d72f2f924e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:04Z,use_quota=True,user_id='f249f1c288d64940af51a3184e01d4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Creating volume 15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:12 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fdb7460-64c6-47e8-8882-1a2117651f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d1d389-8e13-40ee-9114-f248b3cbfd79', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:12 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb 1073741824 Sep 28 17:23:12 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9fad31-a02f-4b96-b2e0-050925620297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:12 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Volume volume-57d1d389-8e13-40ee-9114-f248b3cbfd79 (57d1d389-8e13-40ee-9114-f248b3cbfd79): created successfully Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9fad31-a02f-4b96-b2e0-050925620297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Flow 'volume_create_manager' (60f6adfa-d383-4523-abfc-050bfd43d59f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:12 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-c98c654e-ba5e-4bac-acf0-206b17831ceb tempest-CreateVolumesFromSnapshotTest-1298566375 None] Created volume successfully. Sep 28 17:23:12 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef" returned: 0 in 0.444s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:12 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef Sep 28 17:23:12 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:13 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61.f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef" returned: 0 in 0.297s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] Lock "cinder-quobyte-f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef" released by "_delete_snapshot" :: held 1.948s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] Lock "cinder-quobyte-46706549-ebec-4a51-9ac1-0db7f6f1ed61" released by "delete_snapshot" :: held 1.976s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] Created reservations ['7953cb22-b320-4ce0-8508-5fa18f2e890c', '3ea2dd2c-cf49-4906-9fc5-eb2d8fe30244', '1bc5ae34-2c24-499c-85bc-fb373742c767', 'd771a047-9fff-47b4-873e-323f4249bfed'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "cinder-57d1d389-8e13-40ee-9114-f248b3cbfd79-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-57d1d389-8e13-40ee-9114-f248b3cbfd79-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:13 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb 1073741824" returned: 0 in 0.613s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "cinder-quobyte-57d1d389-8e13-40ee-9114-f248b3cbfd79" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:13 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] Delete snapshot completed successfully. Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-quobyte-57d1d389-8e13-40ee-9114-f248b3cbfd79" acquired by "delete_volume" :: waited 0.034s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-704cfbbe-0673-42ab-a9b1-2f979e910645 tempest-CinderUnicodeTest-1959528220 None] Lock "cinder-f8c5a3fb-b99e-46e3-b3b4-d185f74f6aef-delete_snapshot" released by "delete_snapshot" :: held 2.240s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88338d2-04f8-4766-8324-9673dafa5605]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-57d1d389-8e13-40ee-9114-f248b3cbfd79 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:13 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb Sep 28 17:23:13 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:13 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-57d1d389-8e13-40ee-9114-f248b3cbfd79 Sep 28 17:23:13 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:13 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb" returned: 0 in 0.301s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.233s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1968530964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0769dc-725a-4d23-a284-20cac0009a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5137d86e24974e68accf0307ba2d89a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:07Z,use_quota=True,user_id='60f9c139ea0d4620b4505a585245fcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Creating volume 2c0769dc-725a-4d23-a284-20cac0009a83 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:13 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302738fa-0fd1-4d20-a8b2-03f60cf8dc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb7ebdd-f788-4ad9-8376-e2e976f4614e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:13 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Volume volume-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb (15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb): created successfully Sep 28 17:23:13 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83 1073741824 Sep 28 17:23:13 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb7ebdd-f788-4ad9-8376-e2e976f4614e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Flow 'volume_create_manager' (36a92c06-f585-4061-86e6-67fb059fa394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:13 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-550289ff-20eb-4540-9c23-6aafa576cc05 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Created volume successfully. Sep 28 17:23:13 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-57d1d389-8e13-40ee-9114-f248b3cbfd79" returned: 0 in 0.410s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-57d1d389-8e13-40ee-9114-f248b3cbfd79 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:14 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-57d1d389-8e13-40ee-9114-f248b3cbfd79 Sep 28 17:23:14 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:14 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-57d1d389-8e13-40ee-9114-f248b3cbfd79" returned: 0 in 0.300s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-quobyte-57d1d389-8e13-40ee-9114-f248b3cbfd79" released by "delete_volume" :: held 0.767s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "cinder-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Created reservations ['a2bcaf9e-1393-49d3-8d73-69980a0ce62a', '0a955c6e-1884-4477-adca-730215bbb20d', '9780acd0-6721-448e-a9b6-aed0c401f265', 'd94cc7a3-e71d-4ebc-9bce-e480556d9364'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "cinder-quobyte-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:14 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-quobyte-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb" acquired by "delete_volume" :: waited 0.075s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:14 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:14 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83 1073741824" returned: 0 in 0.713s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] Acquiring lock "cinder-46706549-ebec-4a51-9ac1-0db7f6f1ed61-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e0a987-787b-4622-8154-074c6016ca93]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] Lock "cinder-46706549-ebec-4a51-9ac1-0db7f6f1ed61-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "cinder-5ea539f4-9b9d-4f9c-9605-e59f8773c801-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] Acquiring lock "cinder-quobyte-46706549-ebec-4a51-9ac1-0db7f6f1ed61" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-5ea539f4-9b9d-4f9c-9605-e59f8773c801-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:14 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83 Sep 28 17:23:14 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] Lock "cinder-quobyte-46706549-ebec-4a51-9ac1-0db7f6f1ed61" acquired by "delete_volume" :: waited 0.035s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:14 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb Sep 28 17:23:14 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a1a184-ae92-4d83-9df5-618466ad75bb]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "cinder-quobyte-5ea539f4-9b9d-4f9c-9605-e59f8773c801" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-quobyte-5ea539f4-9b9d-4f9c-9605-e59f8773c801" acquired by "delete_volume" :: waited 0.033s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b43c5b-4bed-4fde-8471-956e6a21c71c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5ea539f4-9b9d-4f9c-9605-e59f8773c801 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:15 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83" returned: 0 in 0.404s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9d1b94-fa53-4f6a-bb23-53f34d782bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c0769dc-725a-4d23-a284-20cac0009a83', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19bc6f2-5d17-41ef-8d69-8da33c2e58e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:15 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61 Sep 28 17:23:15 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:15 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:15 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Volume volume-2c0769dc-725a-4d23-a284-20cac0009a83 (2c0769dc-725a-4d23-a284-20cac0009a83): created successfully Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19bc6f2-5d17-41ef-8d69-8da33c2e58e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Flow 'volume_create_manager' (41627a07-58e0-4a6e-aecd-a12e717c7070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.634s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:15 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb" returned: 0 in 0.562s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:15 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5ea539f4-9b9d-4f9c-9605-e59f8773c801 Sep 28 17:23:15 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:15 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Deleted volume successfully. Sep 28 17:23:15 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-9eb4af91-8f79-4c2b-83ed-06c0fc075ef4 tempest-ProjectReaderTests-1504665076 None] Created volume successfully. Sep 28 17:23:15 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb Sep 28 17:23:15 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9c1d4722-b927-418d-ae1e-a1cf1f639f49 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-57d1d389-8e13-40ee-9114-f248b3cbfd79-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:15 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61" returned: 0 in 0.600s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:15 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5ea539f4-9b9d-4f9c-9605-e59f8773c801" returned: 0 in 0.474s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5ea539f4-9b9d-4f9c-9605-e59f8773c801 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:15 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb" returned: 0 in 0.320s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:15 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61 Sep 28 17:23:15 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5ea539f4-9b9d-4f9c-9605-e59f8773c801 Sep 28 17:23:15 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:15 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-quobyte-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb" released by "delete_volume" :: held 0.988s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Created reservations ['2005c7d7-11e1-4e98-a1e5-ab1c77576de1', '7e9a5ee5-dce9-4510-a39c-075388b5716d', '3c00be35-2984-4237-a98b-c2d2ff4712e3', '77c409f4-89b3-406e-bbe1-f15783f20866'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:15 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:15 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:15 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5ea539f4-9b9d-4f9c-9605-e59f8773c801" returned: 0 in 0.297s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-quobyte-5ea539f4-9b9d-4f9c-9605-e59f8773c801" released by "delete_volume" :: held 0.858s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:15 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-46706549-ebec-4a51-9ac1-0db7f6f1ed61" returned: 0 in 0.365s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] Lock "cinder-quobyte-46706549-ebec-4a51-9ac1-0db7f6f1ed61" released by "delete_volume" :: held 1.116s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] Created reservations ['c3b0883e-d6c1-47ba-a7c2-2910f896a746', '1f64902f-2d3c-40fb-aef9-cc954c7cee6c', 'c2279c1c-3e42-44ad-b7be-e552f44c23df', 'e43fd21b-99ea-41fd-af22-2274e27b3588'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:15 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] Created reservations ['78686508-8811-4f95-a4d2-726dd10b0756', '0dfcd328-bc71-4afb-9e41-24e47cc8cb3d', '5ae48ed0-1d63-498e-b91b-2c77722d88a1', '87e26192-ac58-45e6-8891-1f336d9e3697'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:16 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.415s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:16 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Deleted volume successfully. Sep 28 17:23:16 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:16 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ef0c3075-b75e-4cb5-9afb-8ebdcba9a8b4 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-15ee0a1d-2e1c-4aaa-8ea3-7337b4f664eb-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:16 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:16 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:16 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.301s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:16 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] Deleted volume successfully. Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b5b5370b-834b-4742-88da-9ce83dd14b1d tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-5ea539f4-9b9d-4f9c-9605-e59f8773c801-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] Creating offline snapshot 3fb10c94-1c9e-43c0-ac80-c33947ed2469 of volume 2c0769dc-725a-4d23-a284-20cac0009a83 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:23:16 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.342s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:16 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] Deleted volume successfully. Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[afff6085-c882-4760-82c4-2c9be4f67226]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2d628408-6499-476f-8478-03ef31f6b612 tempest-CinderUnicodeTest-1959528220 None] Lock "cinder-46706549-ebec-4a51-9ac1-0db7f6f1ed61-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:16 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83 Sep 28 17:23:16 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "cinder-432239f3-17ad-4314-92af-261ddbee367f-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-432239f3-17ad-4314-92af-261ddbee367f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "cinder-quobyte-432239f3-17ad-4314-92af-261ddbee367f" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-quobyte-432239f3-17ad-4314-92af-261ddbee367f" acquired by "delete_volume" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[4245fe5f-16d3-462c-9a3f-383d68270054]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-432239f3-17ad-4314-92af-261ddbee367f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] Acquiring lock "cinder-476ab9f7-29e3-413a-a450-eaf432f36e08-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:17 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-432239f3-17ad-4314-92af-261ddbee367f Sep 28 17:23:17 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] Lock "cinder-476ab9f7-29e3-413a-a450-eaf432f36e08-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:17 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "cinder-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83" returned: 0 in 0.583s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:17 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469 1G Sep 28 17:23:17 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] Acquiring lock "cinder-quobyte-476ab9f7-29e3-413a-a450-eaf432f36e08" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] Lock "cinder-quobyte-476ab9f7-29e3-413a-a450-eaf432f36e08" acquired by "delete_volume" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "cinder-quobyte-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[031471c9-68bd-4a77-ad37-f9f52474b9fe]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-476ab9f7-29e3-413a-a450-eaf432f36e08 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-quobyte-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8" acquired by "delete_volume" :: waited 0.037s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cedea3-9247-4823-b27c-a888152b696d]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:17 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-476ab9f7-29e3-413a-a450-eaf432f36e08 Sep 28 17:23:17 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:17 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-432239f3-17ad-4314-92af-261ddbee367f" returned: 0 in 0.577s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-432239f3-17ad-4314-92af-261ddbee367f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:17 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-432239f3-17ad-4314-92af-261ddbee367f Sep 28 17:23:17 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:17 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8 Sep 28 17:23:17 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:17 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469 1G" returned: 0 in 0.644s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c0769dc-725a-4d23-a284-20cac0009a83 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:17 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c0769dc-725a-4d23-a284-20cac0009a83 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469 Sep 28 17:23:17 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:17 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-476ab9f7-29e3-413a-a450-eaf432f36e08" returned: 0 in 0.602s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-476ab9f7-29e3-413a-a450-eaf432f36e08 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:17 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-476ab9f7-29e3-413a-a450-eaf432f36e08 Sep 28 17:23:17 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:17 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-432239f3-17ad-4314-92af-261ddbee367f" returned: 0 in 0.451s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-quobyte-432239f3-17ad-4314-92af-261ddbee367f" released by "delete_volume" :: held 1.099s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:17 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8" returned: 0 in 0.648s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:18 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8 Sep 28 17:23:18 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Created reservations ['8e6efdf3-dfc7-4c2d-8ae0-ee1169f6eac1', '4eb7580c-973f-4e43-a0c8-139435032dbb', 'b7ffd189-4846-4607-bf7f-6d64a4e3ead8', 'c0e0cf60-1ec6-4c71-b9da-5386fe40a15a'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:18 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-476ab9f7-29e3-413a-a450-eaf432f36e08" returned: 0 in 0.355s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:18 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:18 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:18 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c0769dc-725a-4d23-a284-20cac0009a83 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469" returned: 0 in 0.495s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:18 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469 is being set with open permissions: ugo+rw Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] Lock "cinder-quobyte-476ab9f7-29e3-413a-a450-eaf432f36e08" released by "delete_volume" :: held 1.055s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:18 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469 Sep 28 17:23:18 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:18 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8" returned: 0 in 0.381s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] Created reservations ['2a534b67-926c-4fa1-a9ad-c52c7908347c', '36e7e2a2-53ec-4197-a295-7f770736f19a', 'c133bd02-eb12-4f2b-b611-36e7ddf812e0', '7bdc3f9d-801a-4c44-b853-ad2f1cd0376b'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-quobyte-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8" released by "delete_volume" :: held 1.091s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Created reservations ['24dc41a5-1f10-471c-ad92-164445da2c7d', '577b3658-3ff3-4271-8a47-dc076fcecf5c', '43ab7799-d199-4285-ad67-363982d32919', '29069d8b-9877-4afd-a00f-40e5f1644260'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:18 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:18 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:18 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.429s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:18 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Deleted volume successfully. Sep 28 17:23:18 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469" returned: 0 in 0.401s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-b51b3183-7702-48d3-9c41-18c828def60e tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-432239f3-17ad-4314-92af-261ddbee367f-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:18 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:18 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:18 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.info Sep 28 17:23:18 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:18 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.348s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:18 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] Deleted volume successfully. Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-a229c518-fb72-432c-8161-e9d78414451c tempest-CinderUnicodeTest-1959528220 None] Lock "cinder-476ab9f7-29e3-413a-a450-eaf432f36e08-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:18 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.307s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:18 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:18 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Deleted volume successfully. Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-cc34ef55-e680-473b-bc79-31b9149aa4c3 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-98d83b82-6dd0-4cb0-ba95-da2ee4e0d2c8-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "cinder-2c58b2fd-bc3d-4c73-892d-9c6f836cea41-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-2c58b2fd-bc3d-4c73-892d-9c6f836cea41-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:19 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.info" returned: 0 in 0.361s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:19 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.info is being set with open permissions: ugo+rw Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:19 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.info Sep 28 17:23:19 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "cinder-quobyte-2c58b2fd-bc3d-4c73-892d-9c6f836cea41" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-quobyte-2c58b2fd-bc3d-4c73-892d-9c6f836cea41" acquired by "delete_volume" :: waited 0.017s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e098d91-b6f1-4b9b-949b-61cdca9ad8d3]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c58b2fd-bc3d-4c73-892d-9c6f836cea41 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:19 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c58b2fd-bc3d-4c73-892d-9c6f836cea41 Sep 28 17:23:19 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:19 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.info" returned: 0 in 0.329s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.979s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "cinder-cfe4c639-ed87-497f-9bb5-ae27d31c336b-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-cfe4c639-ed87-497f-9bb5-ae27d31c336b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:19 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ee777614-45d1-42b6-bd85-7258e2d58c00 tempest-ProjectReaderTests-1504665076 None] Create snapshot completed successfully Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "cinder-quobyte-cfe4c639-ed87-497f-9bb5-ae27d31c336b" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-quobyte-cfe4c639-ed87-497f-9bb5-ae27d31c336b" acquired by "delete_volume" :: waited 0.024s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[913331b2-ba70-4d45-a1d2-28f424d6fc67]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfe4c639-ed87-497f-9bb5-ae27d31c336b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:19 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c58b2fd-bc3d-4c73-892d-9c6f836cea41" returned: 0 in 0.490s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c58b2fd-bc3d-4c73-892d-9c6f836cea41 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:19 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c58b2fd-bc3d-4c73-892d-9c6f836cea41 Sep 28 17:23:19 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:19 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfe4c639-ed87-497f-9bb5-ae27d31c336b Sep 28 17:23:19 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:20 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-3fb10c94-1c9e-43c0-ac80-c33947ed2469-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c58b2fd-bc3d-4c73-892d-9c6f836cea41" returned: 0 in 0.382s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-3fb10c94-1c9e-43c0-ac80-c33947ed2469-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-quobyte-2c0769dc-725a-4d23-a284-20cac0009a83" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-quobyte-2c58b2fd-bc3d-4c73-892d-9c6f836cea41" released by "delete_volume" :: held 0.936s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-2c0769dc-725a-4d23-a284-20cac0009a83" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-quobyte-3fb10c94-1c9e-43c0-ac80-c33947ed2469" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=163,cinder:UPDATE=215,cinder:INSERT=60,cinder:DELETE=22 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-3fb10c94-1c9e-43c0-ac80-c33947ed2469" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] Deleting offline snapshot 3fb10c94-1c9e-43c0-ac80-c33947ed2469 of volume 2c0769dc-725a-4d23-a284-20cac0009a83 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:23:20 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] snapshot_file for this snap is: volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfe4c639-ed87-497f-9bb5-ae27d31c336b" returned: 0 in 0.527s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfe4c639-ed87-497f-9bb5-ae27d31c336b {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[c385feca-4894-41e3-91b8-ec1efceef512]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:20 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfe4c639-ed87-497f-9bb5-ae27d31c336b Sep 28 17:23:20 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Created reservations ['9746e61e-e936-41e5-b5de-537610dbf082', 'aa6dacd1-efbe-4654-b833-789058137cee', 'fb3ce3ac-e0e9-4347-8f0c-501842af7c1e', '83056a75-2f43-49c0-b997-5cc8a81ad4f8'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:20 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469 Sep 28 17:23:20 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:20 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:20 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:20 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-cfe4c639-ed87-497f-9bb5-ae27d31c336b" returned: 0 in 0.411s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-quobyte-cfe4c639-ed87-497f-9bb5-ae27d31c336b" released by "delete_volume" :: held 1.017s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:UPDATE=233,cinder:SELECT=179,cinder:INSERT=61,cinder:DELETE=22 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Created reservations ['3404983e-37de-4b25-bfec-4897d6b980ce', '7246b5af-4510-499f-ab18-e157d30c0886', '0ffc5491-94d0-4a41-8cba-dd5ba7f59d5e', '51f080c1-8f80-4579-8af3-be55536c3f4b'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:20 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469" returned: 0 in 0.579s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c0769dc-725a-4d23-a284-20cac0009a83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:20 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.437s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d96ee7-18f7-41fe-b10e-ffbce81ea355]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:20 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:20 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Deleted volume successfully. Sep 28 17:23:20 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-994e1030-1f90-48c7-83b2-6dcd7a2fc65d tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-2c58b2fd-bc3d-4c73-892d-9c6f836cea41-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:21 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83 Sep 28 17:23:21 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:21 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.303s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:21 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Deleted volume successfully. Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-eed55bb1-ea12-4423-a27a-407c17d63235 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-cfe4c639-ed87-497f-9bb5-ae27d31c336b-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "cinder-6208a979-42df-41ce-bcd2-a66051fb2676-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:21 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-6208a979-42df-41ce-bcd2-a66051fb2676-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83" returned: 0 in 0.477s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:21 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469 Sep 28 17:23:21 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "cinder-quobyte-6208a979-42df-41ce-bcd2-a66051fb2676" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-quobyte-6208a979-42df-41ce-bcd2-a66051fb2676" acquired by "delete_volume" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[63abe887-aefe-4f6f-9a78-184c4cdec785]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6208a979-42df-41ce-bcd2-a66051fb2676 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:21 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6208a979-42df-41ce-bcd2-a66051fb2676 Sep 28 17:23:21 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "cinder-280ec51b-eba1-4015-94ed-57f825c1ccfe-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:21 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469" returned: 0 in 0.450s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-280ec51b-eba1-4015-94ed-57f825c1ccfe-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:21 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469 Sep 28 17:23:21 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:21 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "cinder-quobyte-280ec51b-eba1-4015-94ed-57f825c1ccfe" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6208a979-42df-41ce-bcd2-a66051fb2676" returned: 0 in 0.520s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6208a979-42df-41ce-bcd2-a66051fb2676 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:22 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6208a979-42df-41ce-bcd2-a66051fb2676 Sep 28 17:23:22 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-quobyte-280ec51b-eba1-4015-94ed-57f825c1ccfe" acquired by "delete_volume" :: waited 0.037s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[faedcbbe-4fb5-4cdf-9413-5261e7d1b6dd]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-280ec51b-eba1-4015-94ed-57f825c1ccfe {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:22 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83.3fb10c94-1c9e-43c0-ac80-c33947ed2469" returned: 0 in 0.330s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-3fb10c94-1c9e-43c0-ac80-c33947ed2469" released by "_delete_snapshot" :: held 2.061s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-2c0769dc-725a-4d23-a284-20cac0009a83" released by "delete_snapshot" :: held 2.106s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:22 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-280ec51b-eba1-4015-94ed-57f825c1ccfe Sep 28 17:23:22 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] Created reservations ['1a3d26fa-1c98-4b57-aa2a-44214939a909', '184f76c5-768b-42a2-9d53-22c566be3550', 'd99c037e-f312-4b77-b827-14ee55388b39', '490e345b-251b-44a2-bb02-d120585323a9'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:22 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-6208a979-42df-41ce-bcd2-a66051fb2676" returned: 0 in 0.380s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-quobyte-6208a979-42df-41ce-bcd2-a66051fb2676" released by "delete_volume" :: held 0.954s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:22 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] Delete snapshot completed successfully. Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bea79e42-8deb-4ad1-8385-46e535bae061 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-3fb10c94-1c9e-43c0-ac80-c33947ed2469-delete_snapshot" released by "delete_snapshot" :: held 2.413s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Created reservations ['d92c123c-0afc-4e28-8e30-e3bb7e83df38', '7a74f82a-07cf-40db-9c74-2960f03ac9b9', 'e8624db9-1aee-49cf-ab9f-3552af260dd9', '62db19cc-8143-4c02-bf79-8d6269e7c490'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:22 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-280ec51b-eba1-4015-94ed-57f825c1ccfe" returned: 0 in 0.549s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-280ec51b-eba1-4015-94ed-57f825c1ccfe {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:22 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-280ec51b-eba1-4015-94ed-57f825c1ccfe Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:22 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:22 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:22 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:22 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.300s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:22 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-280ec51b-eba1-4015-94ed-57f825c1ccfe" returned: 0 in 0.359s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:22 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Deleted volume successfully. Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-quobyte-280ec51b-eba1-4015-94ed-57f825c1ccfe" released by "delete_volume" :: held 0.985s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4516e8c3-53ee-40a9-bbbc-2a40386ce6db tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-6208a979-42df-41ce-bcd2-a66051fb2676-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Created reservations ['d052a18b-02d5-4be8-b51e-87142822b713', '636d29b6-1ab2-4c21-b3e5-28f142e667fa', '0d3f2260-236f-4898-b7a3-fabb1a6c1b43', '895ab5a9-842d-4da6-bbac-6e3fba7ba4bd'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:23 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:23 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-2c0769dc-725a-4d23-a284-20cac0009a83-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-2c0769dc-725a-4d23-a284-20cac0009a83-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-quobyte-2c0769dc-725a-4d23-a284-20cac0009a83" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-2c0769dc-725a-4d23-a284-20cac0009a83" acquired by "delete_volume" :: waited 0.013s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:23 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[443223f8-05d0-4ce6-92b5-5226efabe4ba]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.345s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:23 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Deleted volume successfully. Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-160e4d8e-1d74-47da-9a2a-ba07de38d837 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-280ec51b-eba1-4015-94ed-57f825c1ccfe-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "cinder-52ab708f-9a76-4fa1-920f-340a4887798f-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-52ab708f-9a76-4fa1-920f-340a4887798f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:23 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83 Sep 28 17:23:23 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "cinder-quobyte-52ab708f-9a76-4fa1-920f-340a4887798f" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-quobyte-52ab708f-9a76-4fa1-920f-340a4887798f" acquired by "delete_volume" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[a065237e-cc6b-4921-8571-4a91caa9cdff]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52ab708f-9a76-4fa1-920f-340a4887798f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:23 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52ab708f-9a76-4fa1-920f-340a4887798f Sep 28 17:23:23 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:23 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-ce709017-2c5e-41d4-8a74-95756259f737 tempest-ProjectAdminTests-792811086 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.153060913086, 'free_capacity_gb': 1775.153060913086, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86970) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:23:24 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83" returned: 0 in 0.567s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:24 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83 Sep 28 17:23:24 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "cinder-a8691e6d-4297-4836-a0ea-0e7f7591bbef-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-a8691e6d-4297-4836-a0ea-0e7f7591bbef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "cinder-quobyte-60291a58-6bc3-4b2f-be67-7ed1dc71cef6" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-quobyte-60291a58-6bc3-4b2f-be67-7ed1dc71cef6" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "cinder-quobyte-a8691e6d-4297-4836-a0ea-0e7f7591bbef" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-quobyte-a8691e6d-4297-4836-a0ea-0e7f7591bbef" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Deleting offline snapshot a8691e6d-4297-4836-a0ea-0e7f7591bbef of volume 60291a58-6bc3-4b2f-be67-7ed1dc71cef6 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] snapshot_file for this snap is: volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:23:24 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52ab708f-9a76-4fa1-920f-340a4887798f" returned: 0 in 0.489s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52ab708f-9a76-4fa1-920f-340a4887798f {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[61da57a8-6ecb-4611-b9fd-016d931bf049]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:24 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52ab708f-9a76-4fa1-920f-340a4887798f Sep 28 17:23:24 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:24 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef Sep 28 17:23:24 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:24 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2c0769dc-725a-4d23-a284-20cac0009a83" returned: 0 in 0.385s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-2c0769dc-725a-4d23-a284-20cac0009a83" released by "delete_volume" :: held 1.044s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] Created reservations ['184a94f7-0942-47b4-9d99-61f0b7ff87ee', '83e6e08a-102c-45a2-9a8d-d2a9139ecfb9', '47791552-274e-4090-a9a3-3e335439c676', 'fbb83f57-0c47-4f8c-89dc-60b9489eb562'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:24 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-52ab708f-9a76-4fa1-920f-340a4887798f" returned: 0 in 0.408s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-quobyte-52ab708f-9a76-4fa1-920f-340a4887798f" released by "delete_volume" :: held 0.953s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:24 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:24 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:24 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef" returned: 0 in 0.527s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Created reservations ['038e5fa3-c74d-4ae1-8d46-3c8a8a41306f', '631b4cfe-c7e4-4880-bdf5-fba74924f18d', '35697a19-f8b6-4596-bfae-eee933af6852', 'cf2e1a60-ef5d-4f58-ae14-ab558eba8101'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada67102-518b-4561-804b-33c2e25d2a15]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:25 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:25 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:25 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6 Sep 28 17:23:25 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:25 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.457s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:25 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:25 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] Deleted volume successfully. Sep 28 17:23:25 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5f799b64-4c17-46a2-8641-2742ce8443c5 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-2c0769dc-725a-4d23-a284-20cac0009a83-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:25 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.313s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:25 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:25 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Deleted volume successfully. Sep 28 17:23:25 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bfffaff9-f180-4125-af76-f3dfd1d7a4f2 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-52ab708f-9a76-4fa1-920f-340a4887798f-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:25 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6" returned: 0 in 0.502s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:25 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef Sep 28 17:23:25 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:25 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef" returned: 0 in 0.464s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:25 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef Sep 28 17:23:25 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "cinder-07017509-6e09-4612-9e6b-423836f646b9-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-07017509-6e09-4612-9e6b-423836f646b9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "cinder-quobyte-07017509-6e09-4612-9e6b-423836f646b9" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-quobyte-07017509-6e09-4612-9e6b-423836f646b9" acquired by "delete_volume" :: waited 0.034s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:26 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6.a8691e6d-4297-4836-a0ea-0e7f7591bbef" returned: 0 in 0.406s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bc6eab-4b77-4f0f-b689-b62889ab7048]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-07017509-6e09-4612-9e6b-423836f646b9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-quobyte-a8691e6d-4297-4836-a0ea-0e7f7591bbef" released by "_delete_snapshot" :: held 2.105s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-quobyte-60291a58-6bc3-4b2f-be67-7ed1dc71cef6" released by "delete_snapshot" :: held 2.138s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Flow 'volume_create_manager' (9accf5ce-87f3-46a6-8c11-6ecfea86c95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2fe97a-efdc-48f8-aaaa-7e1939c8cb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2fe97a-efdc-48f8-aaaa-7e1939c8cb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-333328655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f25c5b0d-59ec-45ca-9e4c-4bdc2b383577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5137d86e24974e68accf0307ba2d89a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:26Z,use_quota=True,user_id='60f9c139ea0d4620b4505a585245fcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa218ec8-98ea-4795-b248-c591ec2d8cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa218ec8-98ea-4795-b248-c591ec2d8cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02cb88cd-955e-43c5-b837-0078d095f95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:26 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-07017509-6e09-4612-9e6b-423836f646b9 Sep 28 17:23:26 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02cb88cd-955e-43c5-b837-0078d095f95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f25c5b0d-59ec-45ca-9e4c-4bdc2b383577', 'volume_name': 'volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b9f08e-5ebe-4bd6-b4f3-0b5eb2c53731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b9f08e-5ebe-4bd6-b4f3-0b5eb2c53731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d1775f-66b3-4367-ada9-e058ac90c142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:26 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Volume f25c5b0d-59ec-45ca-9e4c-4bdc2b383577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577', 'volume_size': 1} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-333328655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f25c5b0d-59ec-45ca-9e4c-4bdc2b383577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5137d86e24974e68accf0307ba2d89a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:26Z,use_quota=True,user_id='60f9c139ea0d4620b4505a585245fcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Creating volume f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:26 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:26 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 1073741824 Sep 28 17:23:26 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Created reservations ['8aa09ab5-e14d-4391-af19-8369214e5bd9', '3dcc482d-1303-40b5-bc30-0017fd5c5b8f', '689deee3-e1ad-415a-bb96-58e99a58e51a', '9821ce14-8e8a-4124-b020-e36d76783e4e'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:26 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Delete snapshot completed successfully. Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-8a560a11-4702-492a-8a67-2078fd39d6b2 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-a8691e6d-4297-4836-a0ea-0e7f7591bbef-delete_snapshot" released by "delete_snapshot" :: held 2.543s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:26 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-07017509-6e09-4612-9e6b-423836f646b9" returned: 0 in 0.503s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-07017509-6e09-4612-9e6b-423836f646b9 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:26 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-07017509-6e09-4612-9e6b-423836f646b9 Sep 28 17:23:26 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:27 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 1073741824" returned: 0 in 0.674s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:27 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-07017509-6e09-4612-9e6b-423836f646b9" returned: 0 in 0.376s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-quobyte-07017509-6e09-4612-9e6b-423836f646b9" released by "delete_volume" :: held 1.001s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:27 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 Sep 28 17:23:27 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Created reservations ['af49a330-d9a1-41f0-8b13-f1cbc6bf32a8', 'cb9804ee-52a9-4ffc-a8eb-a51d6ec4069d', '0bbf5368-7a86-4cc3-bb5d-581e3b3203f8', 'c45e2f57-b6fb-4754-baf0-2bcd63c08ef8'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "cinder-60291a58-6bc3-4b2f-be67-7ed1dc71cef6-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:27 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:27 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-60291a58-6bc3-4b2f-be67-7ed1dc71cef6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "cinder-quobyte-60291a58-6bc3-4b2f-be67-7ed1dc71cef6" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-quobyte-60291a58-6bc3-4b2f-be67-7ed1dc71cef6" acquired by "delete_volume" :: waited 0.031s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:27 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577" returned: 0 in 0.431s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[429dcf94-4544-4a16-a280-38745c9ecde8]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d1775f-66b3-4367-ada9-e058ac90c142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39532cb-827f-4ac3-a4f0-ec191af3262b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:27 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Volume volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 (f25c5b0d-59ec-45ca-9e4c-4bdc2b383577): created successfully Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39532cb-827f-4ac3-a4f0-ec191af3262b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Flow 'volume_create_manager' (9accf5ce-87f3-46a6-8c11-6ecfea86c95d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:27 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-68d7cced-f01b-4da9-993d-23ac716882ae tempest-ProjectReaderTests-1504665076 None] Created volume successfully. Sep 28 17:23:27 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6 Sep 28 17:23:27 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:27 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.402s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:27 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Deleted volume successfully. Sep 28 17:23:27 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-9e8337d4-a751-4c18-8bb9-d6875e3cad14 tempest-CreateVolumesFromSourceVolumeTest-673908893 None] Lock "cinder-07017509-6e09-4612-9e6b-423836f646b9-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:28 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6" returned: 0 in 0.440s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:28 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6 Sep 28 17:23:28 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:28 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-60291a58-6bc3-4b2f-be67-7ed1dc71cef6" returned: 0 in 0.326s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:28 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-quobyte-60291a58-6bc3-4b2f-be67-7ed1dc71cef6" released by "delete_volume" :: held 0.880s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:28 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Created reservations ['e425a868-3a46-4793-bf8a-fe751b8a9d8c', '3aa60c82-7ad5-4ecc-8191-9ee60a38f653', '352dc735-029f-4648-83b2-15102bc73682', '8691ad6c-cef9-46f7-8fa6-a8e6bbb00466'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:28 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:28 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:28 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] Creating offline snapshot 874d8e7e-5fd8-43ba-b889-62cd2f81feba of volume f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:23:28 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e3c225-e490-4cf3-8b4d-d41345bb95e6]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:28 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:29 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 Sep 28 17:23:29 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:29 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.366s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:29 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:29 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Deleted volume successfully. Sep 28 17:23:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c69867f4-4437-4fca-90dd-08956e4120a0 tempest-CreateVolumesFromSnapshotTest-1298566375 None] Lock "cinder-60291a58-6bc3-4b2f-be67-7ed1dc71cef6-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:29 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577" returned: 0 in 0.523s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:29 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba 1G Sep 28 17:23:29 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:30 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba 1G" returned: 0 in 0.724s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:30 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba Sep 28 17:23:30 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:30 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (4e51f7d2-3136-4648-9593-d910099bc949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8733310e-1092-4d0e-96a3-411f8fca9f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8733310e-1092-4d0e-96a3-411f8fca9f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-449442928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1711d1-ffca-451e-a813-fea6bf4964cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:30Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52401376-6604-40ff-8b52-c3c01faecff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52401376-6604-40ff-8b52-c3c01faecff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed6b1ff-93f2-4d48-9630-2d513a2368f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed6b1ff-93f2-4d48-9630-2d513a2368f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb1711d1-ffca-451e-a813-fea6bf4964cf', 'volume_name': 'volume-eb1711d1-ffca-451e-a813-fea6bf4964cf', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f404f344-8efa-4a7b-a8b2-2139b4128627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f404f344-8efa-4a7b-a8b2-2139b4128627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6685e2-45ea-44ad-a1b6-15ae7b68a9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:30 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Volume eb1711d1-ffca-451e-a813-fea6bf4964cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb1711d1-ffca-451e-a813-fea6bf4964cf', 'volume_size': 1} Sep 28 17:23:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:30 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba" returned: 0 in 0.492s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:30 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba is being set with open permissions: ugo+rw Sep 28 17:23:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:30 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba Sep 28 17:23:30 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:31 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba" returned: 0 in 0.327s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:31 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.info Sep 28 17:23:31 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:31 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.info" returned: 0 in 0.328s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:31 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.info is being set with open permissions: ugo+rw Sep 28 17:23:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:31 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.info Sep 28 17:23:31 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:31 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.info" returned: 0 in 0.358s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.883s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.215s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-449442928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1711d1-ffca-451e-a813-fea6bf4964cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:30Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Creating volume eb1711d1-ffca-451e-a813-fea6bf4964cf {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:31 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:31 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf 1073741824 Sep 28 17:23:31 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:31 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-65b1af27-9468-4e28-ab96-1bddaffefcfa tempest-ProjectReaderTests-1504665076 None] Create snapshot completed successfully Sep 28 17:23:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-874d8e7e-5fd8-43ba-b889-62cd2f81feba-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] Lock "cinder-874d8e7e-5fd8-43ba-b889-62cd2f81feba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-quobyte-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-quobyte-874d8e7e-5fd8-43ba-b889-62cd2f81feba" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:32 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-874d8e7e-5fd8-43ba-b889-62cd2f81feba" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] Deleting offline snapshot 874d8e7e-5fd8-43ba-b889-62cd2f81feba of volume f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:23:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] snapshot_file for this snap is: volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:23:32 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6e5846-9463-43ec-b6ea-c03922e9805c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:32 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf 1073741824" returned: 0 in 0.744s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:32 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba Sep 28 17:23:32 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:32 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf Sep 28 17:23:32 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:33 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf" returned: 0 in 0.413s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6685e2-45ea-44ad-a1b6-15ae7b68a9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb1711d1-ffca-451e-a813-fea6bf4964cf', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59148a36-80dd-4ad5-a082-6df6d51a240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:33 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba" returned: 0 in 0.675s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:33 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Volume volume-eb1711d1-ffca-451e-a813-fea6bf4964cf (eb1711d1-ffca-451e-a813-fea6bf4964cf): created successfully Sep 28 17:23:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59148a36-80dd-4ad5-a082-6df6d51a240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:33 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (4e51f7d2-3136-4648-9593-d910099bc949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:33 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecb9841-bc5c-4445-a32f-b1652733fc79]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:33 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-17b8b1b8-8dbe-4502-b17f-bea9d7444874 tempest-ProjectMemberTests-630479163 None] Created volume successfully. Sep 28 17:23:33 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 Sep 28 17:23:33 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:33 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577" returned: 0 in 0.535s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:33 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba Sep 28 17:23:33 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:34 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba" returned: 0 in 0.497s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:34 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba Sep 28 17:23:34 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:34 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] Creating offline snapshot b5206c08-7ea2-4030-86c2-3f9d8552d362 of volume eb1711d1-ffca-451e-a813-fea6bf4964cf {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:23:34 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[582ca0c0-3df5-4e54-a9bb-4c1f007880ac]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:34 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf Sep 28 17:23:34 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:34 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577.874d8e7e-5fd8-43ba-b889-62cd2f81feba" returned: 0 in 0.415s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-874d8e7e-5fd8-43ba-b889-62cd2f81feba" released by "_delete_snapshot" :: held 2.305s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577" released by "delete_snapshot" :: held 2.346s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:34 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] Created reservations ['03706560-a045-4253-b4ed-269c490f6b58', '129ec7f0-6a41-4dd3-a796-ee29323f9ff6', 'b3b78bae-10ac-4781-bdfd-25280229b5f3', 'bec2ead6-2f00-4a41-8f5c-1631da3e410d'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:34 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] Delete snapshot completed successfully. Sep 28 17:23:34 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-1bf68d5b-f9c1-4884-97da-6b68d1ddc2eb tempest-ProjectReaderTests-1504665076 None] Lock "cinder-874d8e7e-5fd8-43ba-b889-62cd2f81feba-delete_snapshot" released by "delete_snapshot" :: held 2.583s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:34 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf" returned: 0 in 0.424s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:34 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362 1G Sep 28 17:23:34 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:35 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362 1G" returned: 0 in 0.682s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb1711d1-ffca-451e-a813-fea6bf4964cf -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] Lock "cinder-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:35 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb1711d1-ffca-451e-a813-fea6bf4964cf -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362 Sep 28 17:23:35 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-quobyte-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577" acquired by "delete_volume" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:35 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3ba0f9-9a1a-4e79-b43b-2ceb5d85e9f7]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:35 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 Sep 28 17:23:35 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:36 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb1711d1-ffca-451e-a813-fea6bf4964cf -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362" returned: 0 in 0.596s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:36 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362 is being set with open permissions: ugo+rw Sep 28 17:23:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:36 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362 Sep 28 17:23:36 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:36 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577" returned: 0 in 0.724s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:36 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577 Sep 28 17:23:36 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:36 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362" returned: 0 in 0.470s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:36 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.info Sep 28 17:23:36 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:36 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577" returned: 0 in 0.420s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:36 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577" released by "delete_volume" :: held 1.282s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.info" returned: 0 in 0.332s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:36 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.info is being set with open permissions: ugo+rw Sep 28 17:23:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:37 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.info Sep 28 17:23:37 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:37 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] Created reservations ['9af9c666-f63d-4a9d-a6fb-9ea9a4bf1c25', '1bf9ceb5-a28a-4c7a-8c50-0b736bb0952d', '4d1e747a-e272-459b-b6c5-6411ff349b9c', '3548bb20-24d5-43a1-be89-5dcd41c3b493'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:37 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:37 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:37 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.info" returned: 0 in 0.435s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.089s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:37 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-6c550ad8-06c1-4d6a-a2d9-a5cfc44f32e3 tempest-ProjectMemberTests-630479163 None] Create snapshot completed successfully Sep 28 17:23:37 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.411s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:37 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:37 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] Deleted volume successfully. Sep 28 17:23:37 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-5793d34c-bb6c-4667-b5fd-19e60020247d tempest-ProjectReaderTests-1504665076 None] Lock "cinder-f25c5b0d-59ec-45ca-9e4c-4bdc2b383577-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-b5206c08-7ea2-4030-86c2-3f9d8552d362-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] Lock "cinder-b5206c08-7ea2-4030-86c2-3f9d8552d362-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-eb1711d1-ffca-451e-a813-fea6bf4964cf" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-eb1711d1-ffca-451e-a813-fea6bf4964cf" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-b5206c08-7ea2-4030-86c2-3f9d8552d362" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Flow 'volume_create_manager' (5de7cfd8-df3c-459d-a737-2996f47bd47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23256a86-5db0-40be-b137-8d430d212a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-b5206c08-7ea2-4030-86c2-3f9d8552d362" acquired by "_delete_snapshot" :: waited 0.065s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] Deleting offline snapshot b5206c08-7ea2-4030-86c2-3f9d8552d362 of volume eb1711d1-ffca-451e-a813-fea6bf4964cf {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] snapshot_file for this snap is: volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23256a86-5db0-40be-b137-8d430d212a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2100390639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4131c07-4203-4914-ae6f-1648ceb53852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5137d86e24974e68accf0307ba2d89a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:39Z,use_quota=True,user_id='60f9c139ea0d4620b4505a585245fcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ec1bb1-1554-4c66-b87b-72641ba7695f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ec1bb1-1554-4c66-b87b-72641ba7695f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0434eca6-a51d-4e94-958e-7877188dbe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0434eca6-a51d-4e94-958e-7877188dbe84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4131c07-4203-4914-ae6f-1648ceb53852', 'volume_name': 'volume-e4131c07-4203-4914-ae6f-1648ceb53852', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb69326a-7173-4ccc-b5a6-076001da7c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb69326a-7173-4ccc-b5a6-076001da7c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2fca398-9ec9-4dd7-a223-0b990fa3e2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:38 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Volume e4131c07-4203-4914-ae6f-1648ceb53852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4131c07-4203-4914-ae6f-1648ceb53852', 'volume_size': 1} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2100390639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4131c07-4203-4914-ae6f-1648ceb53852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5137d86e24974e68accf0307ba2d89a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:39Z,use_quota=True,user_id='60f9c139ea0d4620b4505a585245fcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Creating volume e4131c07-4203-4914-ae6f-1648ceb53852 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:38 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c14b06-1daf-4693-9e9a-d379f89f3c97]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:38 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852 1073741824 Sep 28 17:23:38 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:39 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362 Sep 28 17:23:39 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:39 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:39 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852 1073741824" returned: 0 in 0.520s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362" returned: 0 in 0.520s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb1711d1-ffca-451e-a813-fea6bf4964cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:39 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b67703-313c-4416-8578-d41d80f5f1b5]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:39 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852 Sep 28 17:23:39 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:39 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf Sep 28 17:23:39 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:39 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852" returned: 0 in 0.396s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:39 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2fca398-9ec9-4dd7-a223-0b990fa3e2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4131c07-4203-4914-ae6f-1648ceb53852', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6e4e83-ce5f-43c6-9fdc-8f863d48720d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:39 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Volume volume-e4131c07-4203-4914-ae6f-1648ceb53852 (e4131c07-4203-4914-ae6f-1648ceb53852): created successfully Sep 28 17:23:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6e4e83-ce5f-43c6-9fdc-8f863d48720d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:39 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Flow 'volume_create_manager' (5de7cfd8-df3c-459d-a737-2996f47bd47c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:39 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1225e895-a882-4024-b5e3-86e77d425b55 tempest-ProjectReaderTests-1504665076 None] Created volume successfully. Sep 28 17:23:40 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf" returned: 0 in 0.612s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:40 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362 Sep 28 17:23:40 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:40 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362" returned: 0 in 0.476s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:40 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362 Sep 28 17:23:40 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:41 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf.b5206c08-7ea2-4030-86c2-3f9d8552d362" returned: 0 in 0.484s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-b5206c08-7ea2-4030-86c2-3f9d8552d362" released by "_delete_snapshot" :: held 2.319s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-eb1711d1-ffca-451e-a813-fea6bf4964cf" released by "delete_snapshot" :: held 2.399s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] Creating offline snapshot 380f7f09-c581-4483-be4a-f8a20f50bf67 of volume e4131c07-4203-4914-ae6f-1648ceb53852 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:23:41 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54f09b0-0a8c-4e83-808e-20240241aa47]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:41 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] Created reservations ['fc4db4e9-477f-43a9-bb21-49f56e50c1ec', '237a5204-3005-4ca9-b52d-62af047e8cf8', '9d074440-b086-45e2-976d-ce24391c0a2d', 'd1b08d5c-985b-47c5-8dad-d64c50c2636a'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:41 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] Delete snapshot completed successfully. Sep 28 17:23:41 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852 Sep 28 17:23:41 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:41 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4f5061b9-b619-49a8-b032-008b6073ea0a tempest-ProjectMemberTests-630479163 None] Lock "cinder-b5206c08-7ea2-4030-86c2-3f9d8552d362-delete_snapshot" released by "delete_snapshot" :: held 2.680s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:41 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852" returned: 0 in 0.523s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:41 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67 1G Sep 28 17:23:41 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-eb1711d1-ffca-451e-a813-fea6bf4964cf-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] Lock "cinder-eb1711d1-ffca-451e-a813-fea6bf4964cf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-eb1711d1-ffca-451e-a813-fea6bf4964cf" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-eb1711d1-ffca-451e-a813-fea6bf4964cf" acquired by "delete_volume" :: waited 0.022s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:42 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67 1G" returned: 0 in 0.552s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4131c07-4203-4914-ae6f-1648ceb53852 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:42 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfc6d1d-d83c-4450-a0da-fd03bdbf6c01]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:42 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4131c07-4203-4914-ae6f-1648ceb53852 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67 Sep 28 17:23:42 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:42 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf Sep 28 17:23:42 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:42 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4131c07-4203-4914-ae6f-1648ceb53852 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67" returned: 0 in 0.393s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:42 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67 is being set with open permissions: ugo+rw Sep 28 17:23:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:42 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67 Sep 28 17:23:42 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:42 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf" returned: 0 in 0.443s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:42 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf Sep 28 17:23:42 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:42 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67" returned: 0 in 0.325s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:43 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.info Sep 28 17:23:43 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:43 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-eb1711d1-ffca-451e-a813-fea6bf4964cf" returned: 0 in 0.399s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-eb1711d1-ffca-451e-a813-fea6bf4964cf" released by "delete_volume" :: held 0.952s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:43 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] Created reservations ['4849f0ca-3c47-40cd-848f-1b22f8e298e6', '17a1b5dc-e802-44c2-a0da-f4c0ece83250', 'd3128233-b709-48c7-8d7a-ff75e2ff87c7', '581217ca-8a5e-4bf3-bf3e-db6210285af6'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:43 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:43 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:43 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.info" returned: 0 in 0.377s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:43 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.info is being set with open permissions: ugo+rw Sep 28 17:23:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:43 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.info Sep 28 17:23:43 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:43 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.371s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:43 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:43 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] Deleted volume successfully. Sep 28 17:23:43 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.info" returned: 0 in 0.326s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-2ed8371c-f0de-4c05-890b-f4852706689c tempest-ProjectMemberTests-630479163 None] Lock "cinder-eb1711d1-ffca-451e-a813-fea6bf4964cf-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:43 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-2844a81f-4f4c-40b7-bc0d-5d9653bf80d4 tempest-ProjectReaderTests-1504665076 None] Create snapshot completed successfully Sep 28 17:23:44 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-380f7f09-c581-4483-be4a-f8a20f50bf67-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:44 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-380f7f09-c581-4483-be4a-f8a20f50bf67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:44 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-quobyte-e4131c07-4203-4914-ae6f-1648ceb53852" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:44 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-e4131c07-4203-4914-ae6f-1648ceb53852" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:44 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-quobyte-380f7f09-c581-4483-be4a-f8a20f50bf67" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:44 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-380f7f09-c581-4483-be4a-f8a20f50bf67" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:44 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] Deleting offline snapshot 380f7f09-c581-4483-be4a-f8a20f50bf67 of volume e4131c07-4203-4914-ae6f-1648ceb53852 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:23:44 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] snapshot_file for this snap is: volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:23:44 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6008f1b-d419-46ee-b358-0b2280ba224c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:44 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67 Sep 28 17:23:44 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:44 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67" returned: 0 in 0.572s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:44 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4131c07-4203-4914-ae6f-1648ceb53852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:44 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[929956a2-872e-4abd-95db-00a1fe65582c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (59f24db3-a691-45c7-b233-88ceb81cbf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e53ffbc-13c7-4518-8679-4dc9e41df15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e53ffbc-13c7-4518-8679-4dc9e41df15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1068988054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b290dac-5935-4580-a754-aee2dfb30a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:45Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02001338-f15e-45e0-b437-e164379c50c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02001338-f15e-45e0-b437-e164379c50c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9230ab33-a1a2-4d6e-9418-0422d6a158d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9230ab33-a1a2-4d6e-9418-0422d6a158d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b290dac-5935-4580-a754-aee2dfb30a23', 'volume_name': 'volume-9b290dac-5935-4580-a754-aee2dfb30a23', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:45 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852 Sep 28 17:23:45 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5287409a-72e4-44ee-862a-7f97d4d42cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5287409a-72e4-44ee-862a-7f97d4d42cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30b07eb-0346-48bc-8232-0f05b4e48eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:45 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Volume 9b290dac-5935-4580-a754-aee2dfb30a23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b290dac-5935-4580-a754-aee2dfb30a23', 'volume_size': 1} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1068988054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b290dac-5935-4580-a754-aee2dfb30a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:45Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Creating volume 9b290dac-5935-4580-a754-aee2dfb30a23 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:45 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:45 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23 1073741824 Sep 28 17:23:45 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:45 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852" returned: 0 in 0.523s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:45 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67 Sep 28 17:23:45 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:45 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23 1073741824" returned: 0 in 0.611s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:45 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23 Sep 28 17:23:45 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:45 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67" returned: 0 in 0.494s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:45 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67 Sep 28 17:23:46 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:46 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23" returned: 0 in 0.304s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:46 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30b07eb-0346-48bc-8232-0f05b4e48eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b290dac-5935-4580-a754-aee2dfb30a23', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedae567-629d-458e-9b62-c3e5af8fe9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:46 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Volume volume-9b290dac-5935-4580-a754-aee2dfb30a23 (9b290dac-5935-4580-a754-aee2dfb30a23): created successfully Sep 28 17:23:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedae567-629d-458e-9b62-c3e5af8fe9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:46 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (59f24db3-a691-45c7-b233-88ceb81cbf02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:46 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-03b845f2-5635-44cd-91be-02b0c998e7b3 tempest-ProjectMemberTests-630479163 None] Created volume successfully. Sep 28 17:23:46 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852.380f7f09-c581-4483-be4a-f8a20f50bf67" returned: 0 in 0.332s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-380f7f09-c581-4483-be4a-f8a20f50bf67" released by "_delete_snapshot" :: held 2.075s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-e4131c07-4203-4914-ae6f-1648ceb53852" released by "delete_snapshot" :: held 2.112s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:46 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] Created reservations ['d997d672-c060-40be-9cab-4ec036b7a17e', '879b51be-0b93-4542-8fb5-d84d2c26db55', '264d2f51-4750-422e-980c-5bb820b4ea1c', 'cb3301d2-14ba-4324-ab2d-5a99cf7195c9'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:46 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] Delete snapshot completed successfully. Sep 28 17:23:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f8d58ee7-5f33-4c0d-b304-45fb569b3721 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-380f7f09-c581-4483-be4a-f8a20f50bf67-delete_snapshot" released by "delete_snapshot" :: held 2.318s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:47 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] Creating offline snapshot ec9a5185-f1de-41cf-89eb-b35a366926ce of volume 9b290dac-5935-4580-a754-aee2dfb30a23 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:23:47 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfa53f5-f7fc-4363-9b81-6928cbb73566]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:47 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23 Sep 28 17:23:47 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-e4131c07-4203-4914-ae6f-1648ceb53852-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] Lock "cinder-e4131c07-4203-4914-ae6f-1648ceb53852-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-quobyte-e4131c07-4203-4914-ae6f-1648ceb53852" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-e4131c07-4203-4914-ae6f-1648ceb53852" acquired by "delete_volume" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:47 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f66ea5d-231d-4caa-9d75-b49df1c879e2]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:47 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23" returned: 0 in 0.462s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:47 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce 1G Sep 28 17:23:47 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:47 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852 Sep 28 17:23:47 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:48 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852" returned: 0 in 0.417s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:48 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852 Sep 28 17:23:48 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:48 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce 1G" returned: 0 in 0.494s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b290dac-5935-4580-a754-aee2dfb30a23 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:48 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b290dac-5935-4580-a754-aee2dfb30a23 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce Sep 28 17:23:48 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:48 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e4131c07-4203-4914-ae6f-1648ceb53852" returned: 0 in 0.337s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-e4131c07-4203-4914-ae6f-1648ceb53852" released by "delete_volume" :: held 0.857s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] Created reservations ['7054dd03-660c-4c6e-a8e5-63e098bf2d69', '7c24c225-46bd-429a-9ced-aae7a68b9021', '6398827c-6cc6-461d-9dc5-9df4535a9fd7', '5c0c40f2-4053-4ffa-b910-be99d5b13523'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:48 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b290dac-5935-4580-a754-aee2dfb30a23 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce" returned: 0 in 0.416s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:48 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce is being set with open permissions: ugo+rw Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:48 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:48 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:48 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce Sep 28 17:23:48 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:48 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.294s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:48 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] Deleted volume successfully. Sep 28 17:23:48 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-41e3cfdf-cbe4-4b95-8a87-588a0673619d tempest-ProjectReaderTests-1504665076 None] Lock "cinder-e4131c07-4203-4914-ae6f-1648ceb53852-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:49 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce" returned: 0 in 0.377s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:49 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.info Sep 28 17:23:49 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:49 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.info" returned: 0 in 0.383s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:49 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.info is being set with open permissions: ugo+rw Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Flow 'volume_create_manager' (965e554a-bffd-4823-bb10-94891374ab47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bef367e-6a1e-4b76-b9db-caa43230d3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:49 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.info Sep 28 17:23:49 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bef367e-6a1e-4b76-b9db-caa43230d3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1978124796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a248bc1f-cf0a-485c-a7cb-a2f244caf1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5137d86e24974e68accf0307ba2d89a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:49Z,use_quota=True,user_id='60f9c139ea0d4620b4505a585245fcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd20adfe-3e6b-4219-9b59-1e3e1ef6a05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd20adfe-3e6b-4219-9b59-1e3e1ef6a05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6574d7c3-80c1-4937-a7d3-b65dd31ba237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6574d7c3-80c1-4937-a7d3-b65dd31ba237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a248bc1f-cf0a-485c-a7cb-a2f244caf1c3', 'volume_name': 'volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e0c817-3f3c-4a14-8f45-05b66b29fafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e0c817-3f3c-4a14-8f45-05b66b29fafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f32f326-ee64-46b3-b570-5c160eed55a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:49 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Volume a248bc1f-cf0a-485c-a7cb-a2f244caf1c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3', 'volume_size': 1} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:49 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.info" returned: 0 in 0.307s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.543s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.196s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1978124796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a248bc1f-cf0a-485c-a7cb-a2f244caf1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5137d86e24974e68accf0307ba2d89a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:49Z,use_quota=True,user_id='60f9c139ea0d4620b4505a585245fcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Creating volume a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:49 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:49 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 1073741824 Sep 28 17:23:49 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:49 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-a9e2b363-b469-492b-b715-23901d38cdb0 tempest-ProjectMemberTests-630479163 None] Create snapshot completed successfully Sep 28 17:23:50 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 1073741824" returned: 0 in 0.618s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-ec9a5185-f1de-41cf-89eb-b35a366926ce-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] Lock "cinder-ec9a5185-f1de-41cf-89eb-b35a366926ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-9b290dac-5935-4580-a754-aee2dfb30a23" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-9b290dac-5935-4580-a754-aee2dfb30a23" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-ec9a5185-f1de-41cf-89eb-b35a366926ce" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-ec9a5185-f1de-41cf-89eb-b35a366926ce" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] Deleting offline snapshot ec9a5185-f1de-41cf-89eb-b35a366926ce of volume 9b290dac-5935-4580-a754-aee2dfb30a23 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] snapshot_file for this snap is: volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b19df4-8ecb-48fd-88e8-e558b5f6fde0]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:50 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 Sep 28 17:23:50 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:50 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce Sep 28 17:23:50 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:50 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3" returned: 0 in 0.321s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f32f326-ee64-46b3-b570-5c160eed55a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f5bae3-bf02-49e2-9002-5ebe40f71819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:50 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Volume volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 (a248bc1f-cf0a-485c-a7cb-a2f244caf1c3): created successfully Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f5bae3-bf02-49e2-9002-5ebe40f71819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:50 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Flow 'volume_create_manager' (965e554a-bffd-4823-bb10-94891374ab47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:51 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-5e35d3bd-f26c-4096-b6e4-06407474e360 tempest-ProjectReaderTests-1504665076 None] Created volume successfully. Sep 28 17:23:51 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce" returned: 0 in 0.492s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b290dac-5935-4580-a754-aee2dfb30a23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:51 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5cecec-b49d-41c1-ab18-323e0a547e14]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:51 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23 Sep 28 17:23:51 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:51 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23" returned: 0 in 0.652s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:51 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce Sep 28 17:23:51 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] Creating offline snapshot 52aadb1a-390f-4d1e-bd4b-b217048d04fc of volume a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:23:52 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c1387d-8349-4270-ad14-d511f50f5413]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:52 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 Sep 28 17:23:52 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:52 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce" returned: 0 in 0.525s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:52 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce Sep 28 17:23:52 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:52 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23.ec9a5185-f1de-41cf-89eb-b35a366926ce" returned: 0 in 0.288s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:52 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3" returned: 0 in 0.490s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:52 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc 1G Sep 28 17:23:52 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-ec9a5185-f1de-41cf-89eb-b35a366926ce" released by "_delete_snapshot" :: held 2.133s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-9b290dac-5935-4580-a754-aee2dfb30a23" released by "delete_snapshot" :: held 2.162s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:52 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] Created reservations ['ed4d1a9c-12f1-4071-b3f4-9ecf2b93f407', '987fc824-2e53-4e0d-9572-09ecbf44fe9d', 'b2609e1c-59b5-4019-9846-f1cec2645891', 'ef2329f1-a2ac-41a3-81b4-06c3f51a9acf'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:52 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] Delete snapshot completed successfully. Sep 28 17:23:52 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-25c388af-c691-484d-b2ab-5925224e7171 tempest-ProjectMemberTests-630479163 None] Lock "cinder-ec9a5185-f1de-41cf-89eb-b35a366926ce-delete_snapshot" released by "delete_snapshot" :: held 2.409s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:53 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc 1G" returned: 0 in 0.574s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:53 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc Sep 28 17:23:53 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:53 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc" returned: 0 in 0.363s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:53 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc is being set with open permissions: ugo+rw Sep 28 17:23:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:53 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc Sep 28 17:23:53 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:53 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc" returned: 0 in 0.319s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:53 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.info Sep 28 17:23:53 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:53 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-9b290dac-5935-4580-a754-aee2dfb30a23-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] Lock "cinder-9b290dac-5935-4580-a754-aee2dfb30a23-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-9b290dac-5935-4580-a754-aee2dfb30a23" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-9b290dac-5935-4580-a754-aee2dfb30a23" acquired by "delete_volume" :: waited 0.024s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:54 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8eeabf-766d-4c22-b17c-efbe56091ac9]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:54 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.info" returned: 0 in 0.366s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:54 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.info is being set with open permissions: ugo+rw Sep 28 17:23:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:54 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.info Sep 28 17:23:54 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:54 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23 Sep 28 17:23:54 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:54 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.info" returned: 0 in 0.328s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.561s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:54 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-bf1ac03d-3308-4e9b-8a43-552be32a673d tempest-ProjectReaderTests-1504665076 None] Create snapshot completed successfully Sep 28 17:23:54 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23" returned: 0 in 0.504s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:54 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23 Sep 28 17:23:54 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-52aadb1a-390f-4d1e-bd4b-b217048d04fc-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-52aadb1a-390f-4d1e-bd4b-b217048d04fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-quobyte-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:55 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9b290dac-5935-4580-a754-aee2dfb30a23" returned: 0 in 0.434s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-quobyte-52aadb1a-390f-4d1e-bd4b-b217048d04fc" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-9b290dac-5935-4580-a754-aee2dfb30a23" released by "delete_volume" :: held 1.078s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-52aadb1a-390f-4d1e-bd4b-b217048d04fc" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] Deleting offline snapshot 52aadb1a-390f-4d1e-bd4b-b217048d04fc of volume a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] snapshot_file for this snap is: volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[16708c5e-d18b-4353-a036-48aa59b4b48d]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Flow 'volume_create_manager' (aacaf4ce-7b7b-4e02-996f-cb2017fb045c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80672c6a-d408-4c9f-add8-ecc1963165ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] Created reservations ['b6235cca-a299-47a0-b117-468791ac024a', '7453f9ff-07bc-4331-be95-edd3805b6dc9', '7a91a5e4-570c-4fbc-8107-c9b9b5a76dfc', '0b0f9eda-545b-46d8-8054-7928545aa525'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80672c6a-d408-4c9f-add8-ecc1963165ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1810546163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a902765-8ece-45c9-9fff-f4ba978c4da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404e0e81d0da42e2b4dcf01782a78fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:55Z,use_quota=True,user_id='ebdeec8a5ab74da5b8b3032768fcd6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea3201b-efe5-41ca-b1aa-e8bfeffe46ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:55 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea3201b-efe5-41ca-b1aa-e8bfeffe46ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:55 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dbe2def-95b7-496f-94ff-5c323af9cfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dbe2def-95b7-496f-94ff-5c323af9cfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a902765-8ece-45c9-9fff-f4ba978c4da1', 'volume_name': 'volume-1a902765-8ece-45c9-9fff-f4ba978c4da1', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe3e136-1b10-438a-9366-7607f0de859b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe3e136-1b10-438a-9366-7607f0de859b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db22f69-a017-486e-9c3d-72bd692fd7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:55 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Volume 1a902765-8ece-45c9-9fff-f4ba978c4da1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a902765-8ece-45c9-9fff-f4ba978c4da1', 'volume_size': 1} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1810546163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a902765-8ece-45c9-9fff-f4ba978c4da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404e0e81d0da42e2b4dcf01782a78fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:55Z,use_quota=True,user_id='ebdeec8a5ab74da5b8b3032768fcd6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Creating volume 1a902765-8ece-45c9-9fff-f4ba978c4da1 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:55 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1a902765-8ece-45c9-9fff-f4ba978c4da1 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:55 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1a902765-8ece-45c9-9fff-f4ba978c4da1 1073741824 Sep 28 17:23:55 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:55 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:55 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:55 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc" returned: 0 in 0.529s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1087f6-daae-41a6-8776-7213b49fa18f]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:55 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 Sep 28 17:23:55 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:55 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.353s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:56 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:56 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] Deleted volume successfully. Sep 28 17:23:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-81a78456-ab3d-4ad1-9fd5-d7f8e7ecc0e3 tempest-ProjectMemberTests-630479163 None] Lock "cinder-9b290dac-5935-4580-a754-aee2dfb30a23-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:56 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1a902765-8ece-45c9-9fff-f4ba978c4da1 1073741824" returned: 0 in 0.621s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1a902765-8ece-45c9-9fff-f4ba978c4da1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:56 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1a902765-8ece-45c9-9fff-f4ba978c4da1 Sep 28 17:23:56 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:56 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3" returned: 0 in 0.490s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:56 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc Sep 28 17:23:56 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:56 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1a902765-8ece-45c9-9fff-f4ba978c4da1" returned: 0 in 0.334s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:56 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db22f69-a017-486e-9c3d-72bd692fd7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a902765-8ece-45c9-9fff-f4ba978c4da1', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24912d7-1a5a-4159-ba89-5f365f341977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:56 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Volume volume-1a902765-8ece-45c9-9fff-f4ba978c4da1 (1a902765-8ece-45c9-9fff-f4ba978c4da1): created successfully Sep 28 17:23:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24912d7-1a5a-4159-ba89-5f365f341977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:56 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Flow 'volume_create_manager' (aacaf4ce-7b7b-4e02-996f-cb2017fb045c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:56 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0b9dddfe-3ecc-41be-a843-7f09ac164798 tempest-ProjectReaderTests-1365628360 None] Created volume successfully. Sep 28 17:23:56 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc" returned: 0 in 0.542s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:56 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc Sep 28 17:23:56 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (772dfaf6-2c59-4f6f-bf92-1c2228967dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc03b1d0-114b-4919-ac4c-5b9c3c12c5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc03b1d0-114b-4919-ac4c-5b9c3c12c5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1275926303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f08077e-745f-484e-ab4f-1c1680c9706a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:57Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ad1c9a-5244-46d8-a762-c5ce48eaafe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ad1c9a-5244-46d8-a762-c5ce48eaafe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a676be1a-5adb-4935-a9dd-6e52d2ef8b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a676be1a-5adb-4935-a9dd-6e52d2ef8b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f08077e-745f-484e-ab4f-1c1680c9706a', 'volume_name': 'volume-0f08077e-745f-484e-ab4f-1c1680c9706a', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f68ffe-0459-4b17-a5a9-12300639226d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f68ffe-0459-4b17-a5a9-12300639226d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5562dcac-dce3-4abe-9ebc-500be6981ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:57 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Volume 0f08077e-745f-484e-ab4f-1c1680c9706a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f08077e-745f-484e-ab4f-1c1680c9706a', 'volume_size': 1} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1275926303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f08077e-745f-484e-ab4f-1c1680c9706a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:57Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Creating volume 0f08077e-745f-484e-ab4f-1c1680c9706a {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:57 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:57 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a 1073741824 Sep 28 17:23:57 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:57 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3.52aadb1a-390f-4d1e-bd4b-b217048d04fc" returned: 0 in 0.340s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-52aadb1a-390f-4d1e-bd4b-b217048d04fc" released by "_delete_snapshot" :: held 2.070s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3" released by "delete_snapshot" :: held 2.123s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] Created reservations ['9a75d2bd-78b1-4c80-9d1e-d32c037a3d35', '2c2d5d33-177e-4ec6-af96-9a0586430d0d', '3d929a01-28e9-4fb5-a487-6e8ce8ff927d', '41960236-8dd3-4fd3-8e6c-49725a930e31'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:57 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] Delete snapshot completed successfully. Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f0e62798-6511-4d4e-8bb1-c4ae81049471 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-52aadb1a-390f-4d1e-bd4b-b217048d04fc-delete_snapshot" released by "delete_snapshot" :: held 2.376s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:57 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a 1073741824" returned: 0 in 0.599s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] Acquiring lock "cinder-1a902765-8ece-45c9-9fff-f4ba978c4da1-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] Lock "cinder-1a902765-8ece-45c9-9fff-f4ba978c4da1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:57 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a Sep 28 17:23:57 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] Acquiring lock "cinder-quobyte-1a902765-8ece-45c9-9fff-f4ba978c4da1" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] Lock "cinder-quobyte-1a902765-8ece-45c9-9fff-f4ba978c4da1" acquired by "delete_volume" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e38b947-c161-4c09-a2e0-ef8b15cdef77]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1a902765-8ece-45c9-9fff-f4ba978c4da1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:58 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1a902765-8ece-45c9-9fff-f4ba978c4da1 Sep 28 17:23:58 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:58 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a" returned: 0 in 0.307s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5562dcac-dce3-4abe-9ebc-500be6981ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f08077e-745f-484e-ab4f-1c1680c9706a', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b080b17d-073a-4bed-b595-4e4102597379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:58 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Volume volume-0f08077e-745f-484e-ab4f-1c1680c9706a (0f08077e-745f-484e-ab4f-1c1680c9706a): created successfully Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b080b17d-073a-4bed-b595-4e4102597379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (772dfaf6-2c59-4f6f-bf92-1c2228967dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:58 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-8d9f476b-3906-4afd-9661-2070b079ea8f tempest-ProjectMemberTests-630479163 None] Created volume successfully. Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] Lock "cinder-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-quobyte-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3" acquired by "delete_volume" :: waited 0.022s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:58 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1a902765-8ece-45c9-9fff-f4ba978c4da1" returned: 0 in 0.582s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1a902765-8ece-45c9-9fff-f4ba978c4da1 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[566914a3-965a-4fb6-bb0d-080f43db5baa]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:58 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1a902765-8ece-45c9-9fff-f4ba978c4da1 Sep 28 17:23:58 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:58 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 Sep 28 17:23:58 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:58 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-1a902765-8ece-45c9-9fff-f4ba978c4da1" returned: 0 in 0.311s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] Lock "cinder-quobyte-1a902765-8ece-45c9-9fff-f4ba978c4da1" released by "delete_volume" :: held 0.961s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:58 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] Created reservations ['68b90449-b9eb-4a0b-a04a-2ac5ca1779b3', '9efbc710-6f2f-4b23-b540-b3e64764d02d', '7e0fe8a1-d339-4126-8bf6-a6a2ea697f2a', '423cfd3e-41a0-42f0-84c9-85ab089ec5e4'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:59 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3" returned: 0 in 0.493s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:59 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3 Sep 28 17:23:59 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:59 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:59 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:59 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3" returned: 0 in 0.403s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:59 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3" released by "delete_volume" :: held 1.018s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] Creating offline snapshot 120dea58-30fe-4fd9-8741-88cb42411b12 of volume 0f08077e-745f-484e-ab4f-1c1680c9706a {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.369s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:59 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] Deleted volume successfully. Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[32334e60-9cc1-4d52-9666-6bc3e6119f0a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-515a1e78-c386-49a4-942a-896fbc0315ca tempest-ProjectReaderTests-1365628360 None] Lock "cinder-1a902765-8ece-45c9-9fff-f4ba978c4da1-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] Created reservations ['c28f2a85-2e7c-497b-9538-db723b905a9f', 'ce55543a-d571-46e8-9d1f-4d2ec21c9056', '83fa634f-203a-4837-9763-510b7f1ec0d7', '008878a3-fc79-4c3c-abb4-206f2488e1af'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:59 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a Sep 28 17:23:59 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:59 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:23:59 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:59 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a" returned: 0 in 0.478s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:00 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12 1G Sep 28 17:24:00 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:00 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.339s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:00 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:00 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] Deleted volume successfully. Sep 28 17:24:00 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f27dbe8f-46f3-4480-9585-f455c2f32a3a tempest-ProjectReaderTests-1504665076 None] Lock "cinder-a248bc1f-cf0a-485c-a7cb-a2f244caf1c3-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:00 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12 1G" returned: 0 in 0.646s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f08077e-745f-484e-ab4f-1c1680c9706a -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:00 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f08077e-745f-484e-ab4f-1c1680c9706a -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12 Sep 28 17:24:00 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:00 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Flow 'volume_create_manager' (ee5b3b45-8082-4edf-8216-6c4d69a40c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c203fb-48bb-43ad-8c86-832252941776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c203fb-48bb-43ad-8c86-832252941776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-140331075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7f0238-00a0-4471-9ffb-914c7a91180d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404e0e81d0da42e2b4dcf01782a78fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:01Z,use_quota=True,user_id='ebdeec8a5ab74da5b8b3032768fcd6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded287b9-8190-42fa-bd6b-a49b842e6ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded287b9-8190-42fa-bd6b-a49b842e6ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa809a1c-4412-488b-80ec-19370df52f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa809a1c-4412-488b-80ec-19370df52f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a7f0238-00a0-4471-9ffb-914c7a91180d', 'volume_name': 'volume-0a7f0238-00a0-4471-9ffb-914c7a91180d', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c57c25f-743e-4a43-83a7-723c9fbef225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c57c25f-743e-4a43-83a7-723c9fbef225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:00 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81314134-b9d6-4aae-a4f5-7e69e6707934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:00 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Volume 0a7f0238-00a0-4471-9ffb-914c7a91180d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a7f0238-00a0-4471-9ffb-914c7a91180d', 'volume_size': 1} Sep 28 17:24:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:01 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f08077e-745f-484e-ab4f-1c1680c9706a -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12" returned: 0 in 0.408s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:01 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12 is being set with open permissions: ugo+rw Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:01 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12 Sep 28 17:24:01 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:01 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:24:01 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Flow 'volume_create_manager' (aa3a92d2-2939-4fcc-a33c-acaa9b952bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46e7bf6-23ab-4e67-ade7-29bf1b495c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46e7bf6-23ab-4e67-ade7-29bf1b495c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1378244723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ebb7753-608f-435c-a1c9-e4072364f606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5137d86e24974e68accf0307ba2d89a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:01Z,use_quota=True,user_id='60f9c139ea0d4620b4505a585245fcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69b5780-acc7-45f1-a81b-14f05a300082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69b5780-acc7-45f1-a81b-14f05a300082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f1cfa0-6eff-40f4-b3ad-c8dc03e4880f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f1cfa0-6eff-40f4-b3ad-c8dc03e4880f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ebb7753-608f-435c-a1c9-e4072364f606', 'volume_name': 'volume-9ebb7753-608f-435c-a1c9-e4072364f606', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371b4d41-594f-4a74-aa8e-47bff41781f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:01 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371b4d41-594f-4a74-aa8e-47bff41781f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5bcf916-a762-406f-bcc1-66f9d9520cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:01 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Volume 9ebb7753-608f-435c-a1c9-e4072364f606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ebb7753-608f-435c-a1c9-e4072364f606', 'volume_size': 1} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12" returned: 0 in 0.407s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:01 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.info Sep 28 17:24:01 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:01 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.464s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:24:01 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.info" returned: 0 in 0.319s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:01 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.info is being set with open permissions: ugo+rw Sep 28 17:24:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:01 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.info Sep 28 17:24:01 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:02 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.info" returned: 0 in 0.273s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.699s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.316s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-140331075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7f0238-00a0-4471-9ffb-914c7a91180d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404e0e81d0da42e2b4dcf01782a78fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:01Z,use_quota=True,user_id='ebdeec8a5ab74da5b8b3032768fcd6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Creating volume 0a7f0238-00a0-4471-9ffb-914c7a91180d {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:02 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0a7f0238-00a0-4471-9ffb-914c7a91180d 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:02 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0a7f0238-00a0-4471-9ffb-914c7a91180d 1073741824 Sep 28 17:24:02 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:02 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-7404ee55-4925-4a55-98ce-e36fe6ca9261 tempest-ProjectMemberTests-630479163 None] Create snapshot completed successfully Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-120dea58-30fe-4fd9-8741-88cb42411b12-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] Lock "cinder-120dea58-30fe-4fd9-8741-88cb42411b12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-0f08077e-745f-484e-ab4f-1c1680c9706a" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-0f08077e-745f-484e-ab4f-1c1680c9706a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-120dea58-30fe-4fd9-8741-88cb42411b12" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-120dea58-30fe-4fd9-8741-88cb42411b12" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] Deleting offline snapshot 120dea58-30fe-4fd9-8741-88cb42411b12 of volume 0f08077e-745f-484e-ab4f-1c1680c9706a {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:24:02 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] snapshot_file for this snap is: volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0a7f0238-00a0-4471-9ffb-914c7a91180d 1073741824" returned: 0 in 0.637s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f68dc55-15c3-455e-9673-ee746374680c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0a7f0238-00a0-4471-9ffb-914c7a91180d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:02 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0a7f0238-00a0-4471-9ffb-914c7a91180d Sep 28 17:24:02 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:02 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12 Sep 28 17:24:02 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:03 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0a7f0238-00a0-4471-9ffb-914c7a91180d" returned: 0 in 0.272s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.657s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1378244723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ebb7753-608f-435c-a1c9-e4072364f606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5137d86e24974e68accf0307ba2d89a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:01Z,use_quota=True,user_id='60f9c139ea0d4620b4505a585245fcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Creating volume 9ebb7753-608f-435c-a1c9-e4072364f606 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:03 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81314134-b9d6-4aae-a4f5-7e69e6707934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a7f0238-00a0-4471-9ffb-914c7a91180d', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cfbd30-5a9d-4a9a-a589-f0b19f33946f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:03 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606 1073741824 Sep 28 17:24:03 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:03 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Volume volume-0a7f0238-00a0-4471-9ffb-914c7a91180d (0a7f0238-00a0-4471-9ffb-914c7a91180d): created successfully Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cfbd30-5a9d-4a9a-a589-f0b19f33946f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Flow 'volume_create_manager' (ee5b3b45-8082-4edf-8216-6c4d69a40c80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:03 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-975b7234-56a2-4961-a051-b20877c730f4 tempest-ProjectReaderTests-1365628360 None] Created volume successfully. Sep 28 17:24:03 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12" returned: 0 in 0.461s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f08077e-745f-484e-ab4f-1c1680c9706a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[15772b58-9021-4952-b2cf-263fdf4e0e9b]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:03 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a Sep 28 17:24:03 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:03 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606 1073741824" returned: 0 in 0.528s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:03 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606 Sep 28 17:24:03 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:03 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a" returned: 0 in 0.493s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:03 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12 Sep 28 17:24:03 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] Acquiring lock "cinder-0a7f0238-00a0-4471-9ffb-914c7a91180d-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] Lock "cinder-0a7f0238-00a0-4471-9ffb-914c7a91180d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:03 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606" returned: 0 in 0.318s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5bcf916-a762-406f-bcc1-66f9d9520cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ebb7753-608f-435c-a1c9-e4072364f606', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83f7fc2-331f-496c-a112-5b47bc77d0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] Acquiring lock "cinder-quobyte-0a7f0238-00a0-4471-9ffb-914c7a91180d" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:04 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Volume volume-9ebb7753-608f-435c-a1c9-e4072364f606 (9ebb7753-608f-435c-a1c9-e4072364f606): created successfully Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83f7fc2-331f-496c-a112-5b47bc77d0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Flow 'volume_create_manager' (aa3a92d2-2939-4fcc-a33c-acaa9b952bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] Lock "cinder-quobyte-0a7f0238-00a0-4471-9ffb-914c7a91180d" acquired by "delete_volume" :: waited 0.039s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:04 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-4e01974e-f4fc-4c32-88ea-9e21bb6d1593 tempest-ProjectReaderTests-1504665076 None] Created volume successfully. Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[a210035e-14b3-4ceb-b771-8e67c931a7b2]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0a7f0238-00a0-4471-9ffb-914c7a91180d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:04 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12" returned: 0 in 0.430s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:04 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0a7f0238-00a0-4471-9ffb-914c7a91180d Sep 28 17:24:04 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:04 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12 Sep 28 17:24:04 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:04 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a.120dea58-30fe-4fd9-8741-88cb42411b12" returned: 0 in 0.316s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:04 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0a7f0238-00a0-4471-9ffb-914c7a91180d" returned: 0 in 0.459s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0a7f0238-00a0-4471-9ffb-914c7a91180d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-120dea58-30fe-4fd9-8741-88cb42411b12" released by "_delete_snapshot" :: held 1.855s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:04 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0a7f0238-00a0-4471-9ffb-914c7a91180d Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-0f08077e-745f-484e-ab4f-1c1680c9706a" released by "delete_snapshot" :: held 1.895s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:04 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] Created reservations ['c5c5d4ed-5cdb-45af-b2d5-14d5840bfcb1', '215546a6-a08a-418f-b8dc-ded8af1a8341', '69e1328d-07a9-4ca7-844c-36305f91f1f7', '9617837f-eb63-4fd1-9b38-27f046ec815c'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] Creating offline snapshot 95858b01-bf9e-4073-affd-bfa5dc42bf3a of volume 9ebb7753-608f-435c-a1c9-e4072364f606 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef507d2-8f63-47d5-b6c6-2c337bf8f972]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:04 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] Delete snapshot completed successfully. Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f4037351-8864-4d4a-bb31-111b7616166f tempest-ProjectMemberTests-630479163 None] Lock "cinder-120dea58-30fe-4fd9-8741-88cb42411b12-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-0f08077e-745f-484e-ab4f-1c1680c9706a-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:04 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] Lock "cinder-0f08077e-745f-484e-ab4f-1c1680c9706a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:04 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606 Sep 28 17:24:04 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:04 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0a7f0238-00a0-4471-9ffb-914c7a91180d" returned: 0 in 0.429s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] Lock "cinder-quobyte-0a7f0238-00a0-4471-9ffb-914c7a91180d" released by "delete_volume" :: held 0.954s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-0f08077e-745f-484e-ab4f-1c1680c9706a" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-0f08077e-745f-484e-ab4f-1c1680c9706a" acquired by "delete_volume" :: waited 0.039s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdc97e4-d186-4c6b-9e42-fc8674d93bbc]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] Created reservations ['cc4fbc2b-eb22-4de1-a812-ca790e717074', '7741cd8d-2b45-4de0-afaa-47d261d9a4dd', '85884968-4bc5-4e49-947f-0be99ff88a61', '7fa8644b-bb02-4b7f-8787-57f46fe04696'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:05 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a Sep 28 17:24:05 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:05 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:24:05 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:05 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606" returned: 0 in 0.623s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:05 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a 1G Sep 28 17:24:05 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:05 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a" returned: 0 in 0.500s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:05 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.319s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:05 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] Deleted volume successfully. Sep 28 17:24:05 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a Sep 28 17:24:05 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-629ea563-6f9e-440f-a7e4-b45e3141f40f tempest-ProjectReaderTests-1365628360 None] Lock "cinder-0a7f0238-00a0-4471-9ffb-914c7a91180d-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:05 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a 1G" returned: 0 in 0.482s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ebb7753-608f-435c-a1c9-e4072364f606 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:05 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ebb7753-608f-435c-a1c9-e4072364f606 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a Sep 28 17:24:05 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:05 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-0f08077e-745f-484e-ab4f-1c1680c9706a" returned: 0 in 0.284s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-0f08077e-745f-484e-ab4f-1c1680c9706a" released by "delete_volume" :: held 0.889s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] Created reservations ['1eef102a-23bf-4ac1-8ae1-48fcb09e8b75', '782d9ece-2a73-4570-bc66-172d93c10d07', '9c4a8b2a-94f3-4f5d-9b7f-1ec8c5bd34b2', '5a5d51c3-f008-4bbc-b0a4-94a051fe1083'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:06 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:24:06 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:06 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ebb7753-608f-435c-a1c9-e4072364f606 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a" returned: 0 in 0.358s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:06 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a is being set with open permissions: ugo+rw Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:06 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a Sep 28 17:24:06 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:06 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.280s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:06 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] Deleted volume successfully. Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d998cde8-62d7-4d5c-967f-e7f959a68a32 tempest-ProjectMemberTests-630479163 None] Lock "cinder-0f08077e-745f-484e-ab4f-1c1680c9706a-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:06 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a" returned: 0 in 0.304s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:06 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.info Sep 28 17:24:06 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Flow 'volume_create_manager' (f4296328-6a2e-46db-8c48-1cbb1c6e5a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bfdcfc-2344-4abc-a4e2-70b0b3d92717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:06 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bfdcfc-2344-4abc-a4e2-70b0b3d92717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672978042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9d0970-6cfe-4482-813e-605258720671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404e0e81d0da42e2b4dcf01782a78fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:07Z,use_quota=True,user_id='ebdeec8a5ab74da5b8b3032768fcd6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0adfc4-068e-4990-a7cd-3a90a9728538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0adfc4-068e-4990-a7cd-3a90a9728538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dca8374-c7d4-4aea-827b-f7f429066226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dca8374-c7d4-4aea-827b-f7f429066226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d9d0970-6cfe-4482-813e-605258720671', 'volume_name': 'volume-4d9d0970-6cfe-4482-813e-605258720671', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc694606-da1c-48cc-a0d1-f2148f91ef26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc694606-da1c-48cc-a0d1-f2148f91ef26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae2be98-e7a5-426a-aff9-35f8deb1916e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:06 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Volume 4d9d0970-6cfe-4482-813e-605258720671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d9d0970-6cfe-4482-813e-605258720671', 'volume_size': 1} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.info" returned: 0 in 0.327s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:06 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.info is being set with open permissions: ugo+rw Sep 28 17:24:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:06 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.info Sep 28 17:24:06 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:07 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.info" returned: 0 in 0.281s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.507s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.311s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672978042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9d0970-6cfe-4482-813e-605258720671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404e0e81d0da42e2b4dcf01782a78fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:07Z,use_quota=True,user_id='ebdeec8a5ab74da5b8b3032768fcd6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Creating volume 4d9d0970-6cfe-4482-813e-605258720671 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:07 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4d9d0970-6cfe-4482-813e-605258720671 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:07 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4d9d0970-6cfe-4482-813e-605258720671 1073741824 Sep 28 17:24:07 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:07 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-8f240698-608d-4ec9-a0b2-dda506766d3d tempest-ProjectReaderTests-1504665076 None] Create snapshot completed successfully Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:07 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (7b27e5df-6a9d-4c73-89d9-839af0204188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b42949-de58-4441-9f46-1a7be8e80bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4d9d0970-6cfe-4482-813e-605258720671 1073741824" returned: 0 in 0.582s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b42949-de58-4441-9f46-1a7be8e80bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1140597044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad147b5-e65c-496f-aa29-8169ea3451dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:08Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323f8931-8c7b-4178-8389-b02f28fb0129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323f8931-8c7b-4178-8389-b02f28fb0129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84fb6687-6ac5-4547-9f43-aa2f3237751d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84fb6687-6ac5-4547-9f43-aa2f3237751d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ad147b5-e65c-496f-aa29-8169ea3451dd', 'volume_name': 'volume-4ad147b5-e65c-496f-aa29-8169ea3451dd', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c90d26-f355-41a0-aa70-acc7c0e7e20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c90d26-f355-41a0-aa70-acc7c0e7e20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fa5708-4445-4e18-9512-b5330b0d3b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:07 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Volume 4ad147b5-e65c-496f-aa29-8169ea3451dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ad147b5-e65c-496f-aa29-8169ea3451dd', 'volume_size': 1} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-95858b01-bf9e-4073-affd-bfa5dc42bf3a-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-95858b01-bf9e-4073-affd-bfa5dc42bf3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-quobyte-9ebb7753-608f-435c-a1c9-e4072364f606" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4d9d0970-6cfe-4482-813e-605258720671 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-9ebb7753-608f-435c-a1c9-e4072364f606" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-quobyte-95858b01-bf9e-4073-affd-bfa5dc42bf3a" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:07 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4d9d0970-6cfe-4482-813e-605258720671 Sep 28 17:24:07 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-95858b01-bf9e-4073-affd-bfa5dc42bf3a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:07 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] Deleting offline snapshot 95858b01-bf9e-4073-affd-bfa5dc42bf3a of volume 9ebb7753-608f-435c-a1c9-e4072364f606 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] snapshot_file for this snap is: volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[985b164c-9a04-41d2-9896-a0e3d98946a9]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:08 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a Sep 28 17:24:08 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:08 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4d9d0970-6cfe-4482-813e-605258720671" returned: 0 in 0.263s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.334s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1140597044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad147b5-e65c-496f-aa29-8169ea3451dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:08Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Creating volume 4ad147b5-e65c-496f-aa29-8169ea3451dd {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:08 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae2be98-e7a5-426a-aff9-35f8deb1916e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d9d0970-6cfe-4482-813e-605258720671', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:08 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd 1073741824 Sep 28 17:24:08 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832f27a8-3267-46b7-a0d4-52107000ea38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:08 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Volume volume-4d9d0970-6cfe-4482-813e-605258720671 (4d9d0970-6cfe-4482-813e-605258720671): created successfully Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832f27a8-3267-46b7-a0d4-52107000ea38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Flow 'volume_create_manager' (f4296328-6a2e-46db-8c48-1cbb1c6e5a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:08 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-7b21a4f0-16e8-4e06-ba20-6e4918aac2b1 tempest-ProjectReaderTests-1365628360 None] Created volume successfully. Sep 28 17:24:08 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a" returned: 0 in 0.410s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ebb7753-608f-435c-a1c9-e4072364f606(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6059a88-57ca-43d1-8739-83d36288bbdb]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:08 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606 Sep 28 17:24:08 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:08 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd 1073741824" returned: 0 in 0.478s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:08 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd Sep 28 17:24:08 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:08 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606" returned: 0 in 0.435s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:08 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a Sep 28 17:24:08 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:08 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] Acquiring lock "cinder-4d9d0970-6cfe-4482-813e-605258720671-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] Lock "cinder-4d9d0970-6cfe-4482-813e-605258720671-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] Acquiring lock "cinder-quobyte-4d9d0970-6cfe-4482-813e-605258720671" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:09 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd" returned: 0 in 0.341s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] Lock "cinder-quobyte-4d9d0970-6cfe-4482-813e-605258720671" acquired by "delete_volume" :: waited 0.028s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fa5708-4445-4e18-9512-b5330b0d3b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ad147b5-e65c-496f-aa29-8169ea3451dd', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52725205-e8f6-4dca-8b02-5393d58fd8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[1718ae91-08e6-4129-bcbc-5ac900ffd799]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4d9d0970-6cfe-4482-813e-605258720671 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:09 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Volume volume-4ad147b5-e65c-496f-aa29-8169ea3451dd (4ad147b5-e65c-496f-aa29-8169ea3451dd): created successfully Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52725205-e8f6-4dca-8b02-5393d58fd8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (7b27e5df-6a9d-4c73-89d9-839af0204188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:09 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-95dd7509-ec02-4018-983c-39758a5ab322 tempest-ProjectMemberTests-630479163 None] Created volume successfully. Sep 28 17:24:09 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4d9d0970-6cfe-4482-813e-605258720671 Sep 28 17:24:09 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:09 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a" returned: 0 in 0.428s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:09 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a Sep 28 17:24:09 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:09 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4d9d0970-6cfe-4482-813e-605258720671" returned: 0 in 0.441s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4d9d0970-6cfe-4482-813e-605258720671 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:09 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4d9d0970-6cfe-4482-813e-605258720671 Sep 28 17:24:09 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:09 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606.95858b01-bf9e-4073-affd-bfa5dc42bf3a" returned: 0 in 0.288s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-95858b01-bf9e-4073-affd-bfa5dc42bf3a" released by "_delete_snapshot" :: held 1.684s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-9ebb7753-608f-435c-a1c9-e4072364f606" released by "delete_snapshot" :: held 1.717s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] Created reservations ['9d13b861-5511-4db1-abbe-b516954d1991', 'b95ab756-bfee-4c6f-b011-eb51d32c6eee', 'd0452bc4-1afc-4f07-aaaa-46fe5e08af8d', '8db17bbd-b34b-4506-ae13-a38f238412d1'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:09 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] Delete snapshot completed successfully. Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-fb3af60c-2f5a-4c85-a055-1f548b723d62 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-95858b01-bf9e-4073-affd-bfa5dc42bf3a-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:09 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4d9d0970-6cfe-4482-813e-605258720671" returned: 0 in 0.328s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] Lock "cinder-quobyte-4d9d0970-6cfe-4482-813e-605258720671" released by "delete_volume" :: held 0.821s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:09 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] Created reservations ['ce634e96-283d-4ede-9d9d-3d31d66f19da', '6007301b-7bc3-4d11-b484-20206e3f50ac', '301ed0fb-ed56-4822-8afa-95fa62e05ad9', '6dde6345-8e3a-429e-ad49-3e328ca72f08'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-9ebb7753-608f-435c-a1c9-e4072364f606-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-9ebb7753-608f-435c-a1c9-e4072364f606-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:10 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:24:10 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] Creating offline snapshot 47efcb0f-891a-4a4a-819d-b9768639156d of volume 4ad147b5-e65c-496f-aa29-8169ea3451dd {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[671fda8c-4331-43a7-88cb-4b7610309880]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "cinder-quobyte-9ebb7753-608f-435c-a1c9-e4072364f606" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-9ebb7753-608f-435c-a1c9-e4072364f606" acquired by "delete_volume" :: waited 0.028s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f09c3cf-c743-4cda-96f8-6ae47855a918]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:10 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd Sep 28 17:24:10 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:10 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:10 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606 Sep 28 17:24:10 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.421s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:10 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] Deleted volume successfully. Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-25400ada-3341-4cc7-9235-95f2d80a27c8 tempest-ProjectReaderTests-1365628360 None] Lock "cinder-4d9d0970-6cfe-4482-813e-605258720671-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:10 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd" returned: 0 in 0.524s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:10 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d 1G Sep 28 17:24:10 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Flow 'volume_create_manager' (731e30b9-6567-4d47-ba64-393a57d91c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b114cc8a-564a-46e2-9b5d-7041da86a05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b114cc8a-564a-46e2-9b5d-7041da86a05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182461983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404e0e81d0da42e2b4dcf01782a78fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:11Z,use_quota=True,user_id='ebdeec8a5ab74da5b8b3032768fcd6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23982a57-90b6-46fa-afab-6c0ee137694a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:10 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23982a57-90b6-46fa-afab-6c0ee137694a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d25b70-6796-4b60-b86e-ab043a79cbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d25b70-6796-4b60-b86e-ab043a79cbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526', 'volume_name': 'volume-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7857661c-6322-4ab8-a9f3-7839be8539ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7857661c-6322-4ab8-a9f3-7839be8539ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63256e56-c343-4c43-86ca-6da8c1b89be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:10 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Volume 4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526', 'volume_size': 1} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606" returned: 0 in 0.581s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:10 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:11 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606 Sep 28 17:24:11 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:11 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d 1G" returned: 0 in 0.506s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ad147b5-e65c-496f-aa29-8169ea3451dd -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:11 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:11 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ad147b5-e65c-496f-aa29-8169ea3451dd -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d Sep 28 17:24:11 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-9ebb7753-608f-435c-a1c9-e4072364f606" returned: 0 in 0.370s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-quobyte-9ebb7753-608f-435c-a1c9-e4072364f606" released by "delete_volume" :: held 1.039s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:11 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] Created reservations ['fcafc9ae-2c68-460c-94e1-1a27d5392e7d', '1d248ff0-f163-4677-8c39-3b6a17101f3e', '861564b1-85af-403d-8807-1e78642c7a2f', '8947803e-56bd-4d39-9242-4973ac8a8ff4'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:11 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:11 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:24:11 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:11 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ad147b5-e65c-496f-aa29-8169ea3451dd -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d" returned: 0 in 0.394s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:11 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d is being set with open permissions: ugo+rw Sep 28 17:24:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:11 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d Sep 28 17:24:11 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:11 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:11 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.319s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:11 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:11 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] Deleted volume successfully. Sep 28 17:24:11 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-473bd3e6-8b2c-4b41-90d1-7e3af2e7fcb9 tempest-ProjectReaderTests-1504665076 None] Lock "cinder-9ebb7753-608f-435c-a1c9-e4072364f606-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:12 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d" returned: 0 in 0.321s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:12 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.info Sep 28 17:24:12 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:12 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.info" returned: 0 in 0.289s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:12 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.info is being set with open permissions: ugo+rw Sep 28 17:24:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:12 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.info Sep 28 17:24:12 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:12 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.info" returned: 0 in 0.311s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.496s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.748s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182461983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404e0e81d0da42e2b4dcf01782a78fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:11Z,use_quota=True,user_id='ebdeec8a5ab74da5b8b3032768fcd6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Creating volume 4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:12 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:12 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:24:12 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:12 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526 1073741824 Sep 28 17:24:12 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:12 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-6fd9eaf1-01ae-4cf7-88a8-30d3672f3228 tempest-ProjectMemberTests-630479163 None] Create snapshot completed successfully Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-47efcb0f-891a-4a4a-819d-b9768639156d-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:13 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526 1073741824" returned: 0 in 0.652s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] Lock "cinder-47efcb0f-891a-4a4a-819d-b9768639156d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-4ad147b5-e65c-496f-aa29-8169ea3451dd" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-4ad147b5-e65c-496f-aa29-8169ea3451dd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-47efcb0f-891a-4a4a-819d-b9768639156d" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-47efcb0f-891a-4a4a-819d-b9768639156d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] Deleting offline snapshot 47efcb0f-891a-4a4a-819d-b9768639156d of volume 4ad147b5-e65c-496f-aa29-8169ea3451dd {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:24:13 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526 Sep 28 17:24:13 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] snapshot_file for this snap is: volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c0bddc-750a-4acf-ba75-9b75eb276232]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:13 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d Sep 28 17:24:13 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:13 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526" returned: 0 in 0.342s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63256e56-c343-4c43-86ca-6da8c1b89be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22605c9-6d13-460d-b7ed-d0ef84ed3000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:13 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Volume volume-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526 (4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526): created successfully Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22605c9-6d13-460d-b7ed-d0ef84ed3000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:13 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Flow 'volume_create_manager' (731e30b9-6567-4d47-ba64-393a57d91c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:13 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-387672b9-2d44-4ab5-aef0-a9d80de5f221 tempest-ProjectReaderTests-1365628360 None] Created volume successfully. Sep 28 17:24:14 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d" returned: 0 in 0.524s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:14 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ad147b5-e65c-496f-aa29-8169ea3451dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:24:14 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14e0651-61ac-4d0f-aa52-e1dd29d174d6]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] Acquiring lock "cinder-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] Lock "cinder-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] Acquiring lock "cinder-quobyte-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:14 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] Lock "cinder-quobyte-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526" acquired by "delete_volume" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:14 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd Sep 28 17:24:14 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:14 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7fafcc-a85b-48ea-8c74-6e79964feac1]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:14 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526 Sep 28 17:24:14 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:14 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd" returned: 0 in 0.524s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:14 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d Sep 28 17:24:14 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:14 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526" returned: 0 in 0.516s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:14 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:14 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526 Sep 28 17:24:14 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:15 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d" returned: 0 in 0.460s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:15 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526" returned: 0 in 0.325s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] Lock "cinder-quobyte-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526" released by "delete_volume" :: held 0.902s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:15 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d Sep 28 17:24:15 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] Created reservations ['4110d8fd-ed0d-467e-80c8-0ffa19d3fea5', 'b0d9e417-b40c-4f9c-a6b1-05c65188f073', 'f8d932d8-16b9-48c7-9e1e-d18ef8cea386', '9fae2d51-1f74-442d-893f-65ff09a22c12'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:15 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:24:15 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:15 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd.47efcb0f-891a-4a4a-819d-b9768639156d" returned: 0 in 0.310s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-47efcb0f-891a-4a4a-819d-b9768639156d" released by "_delete_snapshot" :: held 1.980s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-4ad147b5-e65c-496f-aa29-8169ea3451dd" released by "delete_snapshot" :: held 2.022s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] Created reservations ['11fb8f8b-cf4e-4cf7-94c2-409ab491eae3', '99f11475-00c4-4061-a3b9-6eeca690fbfb', '10791bae-e725-4c6f-bf5b-2adf2d53b57e', 'c84f1e6a-ee56-4e2b-9b34-9e6636828297'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:15 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.305s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:15 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] Deleted volume successfully. Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f3fb21ae-9414-43e7-94ad-f9a38d33836c tempest-ProjectReaderTests-1365628360 None] Lock "cinder-4bfcf1c2-69a0-44e2-a22e-d70ee4dc6526-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:15 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] Delete snapshot completed successfully. Sep 28 17:24:15 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ace50b0f-4fce-4fa3-a07b-fae7e522a5c9 tempest-ProjectMemberTests-630479163 None] Lock "cinder-47efcb0f-891a-4a4a-819d-b9768639156d-delete_snapshot" released by "delete_snapshot" :: held 2.251s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-4ad147b5-e65c-496f-aa29-8169ea3451dd-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] Lock "cinder-4ad147b5-e65c-496f-aa29-8169ea3451dd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-4ad147b5-e65c-496f-aa29-8169ea3451dd" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:16 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-4ad147b5-e65c-496f-aa29-8169ea3451dd" acquired by "delete_volume" :: waited 0.024s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:16 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c336bc6-c1fc-40b8-9ae5-6e597c5b7dc1]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:16 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:16 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd Sep 28 17:24:16 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:17 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd" returned: 0 in 0.505s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:17 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd Sep 28 17:24:17 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:17 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-4ad147b5-e65c-496f-aa29-8169ea3451dd" returned: 0 in 0.358s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-4ad147b5-e65c-496f-aa29-8169ea3451dd" released by "delete_volume" :: held 0.955s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Flow 'volume_create_manager' (efbd26f0-ee55-433f-bf17-03316a03a4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d89441-e899-468d-bb8e-7ee298ccd105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d89441-e899-468d-bb8e-7ee298ccd105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1690102251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d2a2f4-7362-41e3-828c-3e0ccdae8593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57398c3861bb4c56980ec0f95ed916c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:18Z,use_quota=True,user_id='8208cb37d33446e193fb2e9554070b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25655341-e56c-42c0-8c52-32386a5c50b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25655341-e56c-42c0-8c52-32386a5c50b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9421c4b-1cda-466d-90ca-4186f6b96814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9421c4b-1cda-466d-90ca-4186f6b96814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d2a2f4-7362-41e3-828c-3e0ccdae8593', 'volume_name': 'volume-76d2a2f4-7362-41e3-828c-3e0ccdae8593', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8e1a7e-8bca-41ed-a112-4441c0c7bc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8e1a7e-8bca-41ed-a112-4441c0c7bc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38bcc5ef-1d52-4fe5-85d3-250b03815f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:17 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Volume 76d2a2f4-7362-41e3-828c-3e0ccdae8593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d2a2f4-7362-41e3-828c-3e0ccdae8593', 'volume_size': 1} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1690102251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d2a2f4-7362-41e3-828c-3e0ccdae8593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57398c3861bb4c56980ec0f95ed916c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:18Z,use_quota=True,user_id='8208cb37d33446e193fb2e9554070b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Creating volume 76d2a2f4-7362-41e3-828c-3e0ccdae8593 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:17 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-76d2a2f4-7362-41e3-828c-3e0ccdae8593 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:17 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-76d2a2f4-7362-41e3-828c-3e0ccdae8593 1073741824 Sep 28 17:24:17 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:17 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] Created reservations ['b4409456-b19d-40d6-8521-a1bd4b8fe5e8', '000c71b9-a4b0-451b-b68f-0f0e475e24ec', '92c9ab33-4304-4fcd-b548-70802e017946', '665cca25-7ed1-4694-b757-762c1aa22172'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:18 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:24:18 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:18 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.276s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:18 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] Deleted volume successfully. Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f95e6fc2-1ad1-4911-95ee-174bec7ca079 tempest-ProjectMemberTests-630479163 None] Lock "cinder-4ad147b5-e65c-496f-aa29-8169ea3451dd-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:18 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-76d2a2f4-7362-41e3-828c-3e0ccdae8593 1073741824" returned: 0 in 0.508s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-76d2a2f4-7362-41e3-828c-3e0ccdae8593 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:18 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-76d2a2f4-7362-41e3-828c-3e0ccdae8593 Sep 28 17:24:18 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:18 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-76d2a2f4-7362-41e3-828c-3e0ccdae8593" returned: 0 in 0.291s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38bcc5ef-1d52-4fe5-85d3-250b03815f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d2a2f4-7362-41e3-828c-3e0ccdae8593', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61323942-a776-4bd3-9776-0e903d264d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:18 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Volume volume-76d2a2f4-7362-41e3-828c-3e0ccdae8593 (76d2a2f4-7362-41e3-828c-3e0ccdae8593): created successfully Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61323942-a776-4bd3-9776-0e903d264d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:18 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Flow 'volume_create_manager' (efbd26f0-ee55-433f-bf17-03316a03a4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:18 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-1fc331a8-7b9c-408d-ae51-494f3874dc0a tempest-ProjectReaderTests-2089209435 None] Created volume successfully. Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (bb585b93-4ff7-4a25-bb07-ca98dab7f6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13947ec-1cb0-42ae-9904-ada889983b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13947ec-1cb0-42ae-9904-ada889983b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-242968109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d39257b-2702-40dc-96d5-5a35ab549577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:19Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07b8a1b-c71d-4d13-bbda-563283dc6e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07b8a1b-c71d-4d13-bbda-563283dc6e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa53f035-86ac-4df8-bb4c-82430a8f3bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa53f035-86ac-4df8-bb4c-82430a8f3bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d39257b-2702-40dc-96d5-5a35ab549577', 'volume_name': 'volume-8d39257b-2702-40dc-96d5-5a35ab549577', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fc4344-669d-4d33-bd55-13f4fa26d2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fc4344-669d-4d33-bd55-13f4fa26d2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f46713f-b3be-4557-b073-42deb9085c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:19 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Volume 8d39257b-2702-40dc-96d5-5a35ab549577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d39257b-2702-40dc-96d5-5a35ab549577', 'volume_size': 1} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-242968109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d39257b-2702-40dc-96d5-5a35ab549577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:19Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Creating volume 8d39257b-2702-40dc-96d5-5a35ab549577 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:19 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:24:19 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:19 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577 1073741824 Sep 28 17:24:19 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] Acquiring lock "cinder-76d2a2f4-7362-41e3-828c-3e0ccdae8593-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] Lock "cinder-76d2a2f4-7362-41e3-828c-3e0ccdae8593-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] Acquiring lock "cinder-quobyte-76d2a2f4-7362-41e3-828c-3e0ccdae8593" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] Lock "cinder-quobyte-76d2a2f4-7362-41e3-828c-3e0ccdae8593" acquired by "delete_volume" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8f1146-9af5-44ca-bf50-0a1e22e1a7b0]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-76d2a2f4-7362-41e3-828c-3e0ccdae8593 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:20 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577 1073741824" returned: 0 in 0.550s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:20 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577 Sep 28 17:24:20 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:20 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-76d2a2f4-7362-41e3-828c-3e0ccdae8593 Sep 28 17:24:20 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:20 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577" returned: 0 in 0.302s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:INSERT=73,cinder:UPDATE=269,cinder:SELECT=191,cinder:DELETE=21 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f46713f-b3be-4557-b073-42deb9085c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d39257b-2702-40dc-96d5-5a35ab549577', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0362e3a-c0c0-4c9a-8b41-27a967319718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:20 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Volume volume-8d39257b-2702-40dc-96d5-5a35ab549577 (8d39257b-2702-40dc-96d5-5a35ab549577): created successfully Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0362e3a-c0c0-4c9a-8b41-27a967319718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (bb585b93-4ff7-4a25-bb07-ca98dab7f6c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:20 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-e996ce5e-d93b-4a3d-bcd6-e382516a9313 tempest-ProjectMemberTests-630479163 None] Created volume successfully. Sep 28 17:24:20 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-76d2a2f4-7362-41e3-828c-3e0ccdae8593" returned: 0 in 0.474s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-76d2a2f4-7362-41e3-828c-3e0ccdae8593 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:20 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-76d2a2f4-7362-41e3-828c-3e0ccdae8593 Sep 28 17:24:20 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:20 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-76d2a2f4-7362-41e3-828c-3e0ccdae8593" returned: 0 in 0.277s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] Lock "cinder-quobyte-76d2a2f4-7362-41e3-828c-3e0ccdae8593" released by "delete_volume" :: held 0.800s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:INSERT=67,cinder:UPDATE=263,cinder:DELETE=20,cinder:SELECT=195 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:24:20 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] Created reservations ['8149bc16-0174-4d93-a8c2-ba869a78f777', 'c995c312-e9d1-42b6-bee9-e9ce1505b928', 'f6c66e56-d94b-41a7-aa6c-93d14361063d', 'd83f41b5-29ec-4584-8874-59ff2d0ee972'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:21 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:24:21 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:21 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.270s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:21 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] Deleted volume successfully. Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d11f7d02-1638-43c9-941d-35544d227a21 tempest-ProjectReaderTests-2089209435 None] Lock "cinder-76d2a2f4-7362-41e3-828c-3e0ccdae8593-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Flow 'volume_create_manager' (ad79c934-da57-4d22-b6f1-7c4b6821b525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06855be-ab40-4488-af60-11565227ac9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06855be-ab40-4488-af60-11565227ac9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258281788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90719de5-c88f-4eb1-b679-64ac66c1edae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57398c3861bb4c56980ec0f95ed916c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:22Z,use_quota=True,user_id='8208cb37d33446e193fb2e9554070b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf078a0-952f-4d81-867d-f119849395e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf078a0-952f-4d81-867d-f119849395e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788c7e88-6b10-4cd8-9a4e-d058d0a5e268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788c7e88-6b10-4cd8-9a4e-d058d0a5e268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90719de5-c88f-4eb1-b679-64ac66c1edae', 'volume_name': 'volume-90719de5-c88f-4eb1-b679-64ac66c1edae', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2bb0c3-cb42-45f7-94e7-bc9249ee696e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2bb0c3-cb42-45f7-94e7-bc9249ee696e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816034f0-0c5d-4e9e-b312-8ca916730fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:21 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Volume 90719de5-c88f-4eb1-b679-64ac66c1edae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90719de5-c88f-4eb1-b679-64ac66c1edae', 'volume_size': 1} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258281788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90719de5-c88f-4eb1-b679-64ac66c1edae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57398c3861bb4c56980ec0f95ed916c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:22Z,use_quota=True,user_id='8208cb37d33446e193fb2e9554070b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Creating volume 90719de5-c88f-4eb1-b679-64ac66c1edae {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:21 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-90719de5-c88f-4eb1-b679-64ac66c1edae 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:21 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-90719de5-c88f-4eb1-b679-64ac66c1edae 1073741824 Sep 28 17:24:21 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:21 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:22 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-90719de5-c88f-4eb1-b679-64ac66c1edae 1073741824" returned: 0 in 0.460s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-90719de5-c88f-4eb1-b679-64ac66c1edae {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:22 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-90719de5-c88f-4eb1-b679-64ac66c1edae Sep 28 17:24:22 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:22 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-90719de5-c88f-4eb1-b679-64ac66c1edae" returned: 0 in 0.285s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.764s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:22 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] Creating offline snapshot d7444525-c392-435e-a2f2-5ecf38cf9443 of volume 8d39257b-2702-40dc-96d5-5a35ab549577 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:24:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816034f0-0c5d-4e9e-b312-8ca916730fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90719de5-c88f-4eb1-b679-64ac66c1edae', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dbb0d6-12bd-4f43-9696-8d3e8666f232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:22 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[5787b603-001b-4bee-91d0-c38be6fc8fd1]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:22 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:22 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Volume volume-90719de5-c88f-4eb1-b679-64ac66c1edae (90719de5-c88f-4eb1-b679-64ac66c1edae): created successfully Sep 28 17:24:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dbb0d6-12bd-4f43-9696-8d3e8666f232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:22 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Flow 'volume_create_manager' (ad79c934-da57-4d22-b6f1-7c4b6821b525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:22 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-9233e53a-29c4-4ddb-a586-d8ec35d9d5fd tempest-ProjectReaderTests-2089209435 None] Created volume successfully. Sep 28 17:24:22 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577 Sep 28 17:24:22 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:23 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577" returned: 0 in 0.395s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:23 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443 1G Sep 28 17:24:23 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:23 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443 1G" returned: 0 in 0.442s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:23 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d39257b-2702-40dc-96d5-5a35ab549577 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:23 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d39257b-2702-40dc-96d5-5a35ab549577 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443 Sep 28 17:24:23 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] Acquiring lock "cinder-90719de5-c88f-4eb1-b679-64ac66c1edae-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:23 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] Lock "cinder-90719de5-c88f-4eb1-b679-64ac66c1edae-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] Acquiring lock "cinder-quobyte-90719de5-c88f-4eb1-b679-64ac66c1edae" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:24 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d39257b-2702-40dc-96d5-5a35ab549577 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443" returned: 0 in 0.371s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:24 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443 is being set with open permissions: ugo+rw Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] Lock "cinder-quobyte-90719de5-c88f-4eb1-b679-64ac66c1edae" acquired by "delete_volume" :: waited 0.027s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:24 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443 Sep 28 17:24:24 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc043394-9684-45e3-8e05-626ec69f488a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-90719de5-c88f-4eb1-b679-64ac66c1edae {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:24 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-90719de5-c88f-4eb1-b679-64ac66c1edae Sep 28 17:24:24 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:24 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443" returned: 0 in 0.310s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:24 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.info Sep 28 17:24:24 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:24 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-90719de5-c88f-4eb1-b679-64ac66c1edae" returned: 0 in 0.418s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-90719de5-c88f-4eb1-b679-64ac66c1edae {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:24 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-90719de5-c88f-4eb1-b679-64ac66c1edae Sep 28 17:24:24 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:24 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.info" returned: 0 in 0.339s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:24 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.info is being set with open permissions: ugo+rw Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:24 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.info Sep 28 17:24:24 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:24 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-90719de5-c88f-4eb1-b679-64ac66c1edae" returned: 0 in 0.309s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] Lock "cinder-quobyte-90719de5-c88f-4eb1-b679-64ac66c1edae" released by "delete_volume" :: held 0.777s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] Created reservations ['3ef58d71-eb24-42f9-a993-5fbb48ddd835', '9a5fccea-1ec3-4c11-80ca-5365ad06cb73', '8ebd972c-0bb2-47f9-83fe-955892ca6f97', 'e137c2b1-6655-41c4-8457-877cb4589577'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:24 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:25 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.info" returned: 0 in 0.323s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:25 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:24:25 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:25 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-31ea7289-9f7b-4a6c-b295-a4c724e52e42 tempest-ProjectMemberTests-630479163 None] Create snapshot completed successfully Sep 28 17:24:25 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:25 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.305s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:25 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:25 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] Deleted volume successfully. Sep 28 17:24:25 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-f725ac94-5c75-4d34-8554-2d8627cd2268 tempest-ProjectReaderTests-2089209435 None] Lock "cinder-90719de5-c88f-4eb1-b679-64ac66c1edae-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-d7444525-c392-435e-a2f2-5ecf38cf9443-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] Lock "cinder-d7444525-c392-435e-a2f2-5ecf38cf9443-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-8d39257b-2702-40dc-96d5-5a35ab549577" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-8d39257b-2702-40dc-96d5-5a35ab549577" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-d7444525-c392-435e-a2f2-5ecf38cf9443" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:26 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-d7444525-c392-435e-a2f2-5ecf38cf9443" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] Deleting offline snapshot d7444525-c392-435e-a2f2-5ecf38cf9443 of volume 8d39257b-2702-40dc-96d5-5a35ab549577 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:24:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] snapshot_file for this snap is: volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:24:26 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3913d04-8d25-4d0f-a22c-b22243901758]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:26 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443 Sep 28 17:24:26 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:26 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443" returned: 0 in 0.498s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:26 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d39257b-2702-40dc-96d5-5a35ab549577(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:24:26 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[722dd762-b5cd-49f4-bbff-ceef86f84e8a]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:26 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:26 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577 Sep 28 17:24:26 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:27 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577" returned: 0 in 0.526s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:27 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443 Sep 28 17:24:27 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:27 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443" returned: 0 in 0.416s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:27 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443 Sep 28 17:24:27 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:27 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:27 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577.d7444525-c392-435e-a2f2-5ecf38cf9443" returned: 0 in 0.320s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:28 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-d7444525-c392-435e-a2f2-5ecf38cf9443" released by "_delete_snapshot" :: held 1.912s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:28 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-8d39257b-2702-40dc-96d5-5a35ab549577" released by "delete_snapshot" :: held 1.944s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:28 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] Created reservations ['4a0e9031-1948-4605-adf8-c684e178f168', '57fbb6ba-9ec2-4d31-946d-a09525a14d2f', '62aff0c3-9a94-46c1-8d0e-7fe3d8c3e4d5', 'a6f26073-fe2c-49aa-b153-661a003873e4'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:28 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] Delete snapshot completed successfully. Sep 28 17:24:28 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ee10a0e7-8224-41ad-81a7-dd176b650629 tempest-ProjectMemberTests-630479163 None] Lock "cinder-d7444525-c392-435e-a2f2-5ecf38cf9443-delete_snapshot" released by "delete_snapshot" :: held 2.177s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-8d39257b-2702-40dc-96d5-5a35ab549577-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] Lock "cinder-8d39257b-2702-40dc-96d5-5a35ab549577-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-8d39257b-2702-40dc-96d5-5a35ab549577" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:29 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-8d39257b-2702-40dc-96d5-5a35ab549577" acquired by "delete_volume" :: waited 0.025s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:29 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c8b07d-061b-4de7-950b-ff87686a0555]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:29 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577 Sep 28 17:24:29 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:29 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577" returned: 0 in 0.481s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:29 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:29 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577 Sep 28 17:24:29 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:30 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-8d39257b-2702-40dc-96d5-5a35ab549577" returned: 0 in 0.337s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-8d39257b-2702-40dc-96d5-5a35ab549577" released by "delete_volume" :: held 0.914s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:30 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] Created reservations ['9a68e1ed-efce-4354-a2ac-2da9fa445c39', 'da7eac7a-869d-41b7-b31a-0f60138831f5', 'fcf8da3a-c44e-4e43-8f7c-d3c9ae738e9c', '71fad893-312f-4637-83fd-f48a789da174'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:30 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:24:30 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:30 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.359s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:30 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:30 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] Deleted volume successfully. Sep 28 17:24:30 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-bbef7f74-6fae-4959-ad75-e301056c6bc5 tempest-ProjectMemberTests-630479163 None] Lock "cinder-8d39257b-2702-40dc-96d5-5a35ab549577-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (8a271bf7-2c0a-4da0-8a92-53970480ddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fefd49ee-94ee-44b4-a35d-5793e8026e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fefd49ee-94ee-44b4-a35d-5793e8026e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657674869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d6df34-3f9f-45c3-aeab-38fcb897046d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:31Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156ee0fd-d76b-40d3-8f81-9f87c82ca035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156ee0fd-d76b-40d3-8f81-9f87c82ca035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd5c80c4-6f43-4611-a9c8-48f3f1bf6a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd5c80c4-6f43-4611-a9c8-48f3f1bf6a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9d6df34-3f9f-45c3-aeab-38fcb897046d', 'volume_name': 'volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e1128c-31a2-49ab-8cb2-833edb6e47b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e1128c-31a2-49ab-8cb2-833edb6e47b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9d604e-3c9e-4334-9a1e-29050ac3392a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:31 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Volume a9d6df34-3f9f-45c3-aeab-38fcb897046d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d', 'volume_size': 1} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657674869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d6df34-3f9f-45c3-aeab-38fcb897046d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:31Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Creating volume a9d6df34-3f9f-45c3-aeab-38fcb897046d {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:31 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:31 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d 1073741824 Sep 28 17:24:31 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:31 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d 1073741824" returned: 0 in 0.584s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:31 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d Sep 28 17:24:31 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:32 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d" returned: 0 in 0.308s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9d604e-3c9e-4334-9a1e-29050ac3392a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c7d188-9f30-4229-a152-e793488358ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:32 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Volume volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d (a9d6df34-3f9f-45c3-aeab-38fcb897046d): created successfully Sep 28 17:24:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c7d188-9f30-4229-a152-e793488358ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:32 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (8a271bf7-2c0a-4da0-8a92-53970480ddd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:32 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-bf28b9fa-643f-414c-a1d0-d97808212c21 tempest-ProjectMemberTests-630479163 None] Created volume successfully. Sep 28 17:24:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:33 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] Creating offline snapshot ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4 of volume a9d6df34-3f9f-45c3-aeab-38fcb897046d {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:24:33 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce1a65a-59c4-4ead-b3fe-b76f7950864f]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:33 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d Sep 28 17:24:33 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:33 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d" returned: 0 in 0.407s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:33 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4 1G Sep 28 17:24:33 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:34 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4 1G" returned: 0 in 0.475s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:34 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4 Sep 28 17:24:34 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:34 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4" returned: 0 in 0.334s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:34 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4 is being set with open permissions: ugo+rw Sep 28 17:24:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:34 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4 Sep 28 17:24:34 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:34 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4" returned: 0 in 0.251s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:35 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.info Sep 28 17:24:35 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:35 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.info" returned: 0 in 0.296s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:35 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.info is being set with open permissions: ugo+rw Sep 28 17:24:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:35 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.info Sep 28 17:24:35 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:35 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.info" returned: 0 in 0.259s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.134s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:35 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0c92324d-b94a-403c-be0a-5b9b414cf6fe tempest-ProjectMemberTests-630479163 None] Create snapshot completed successfully Sep 28 17:24:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] Lock "cinder-ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-a9d6df34-3f9f-45c3-aeab-38fcb897046d" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-a9d6df34-3f9f-45c3-aeab-38fcb897046d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] Deleting offline snapshot ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4 of volume a9d6df34-3f9f-45c3-aeab-38fcb897046d {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:24:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] snapshot_file for this snap is: volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:24:36 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dc3ae7-653a-4d22-bb9c-53c311073a10]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:36 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4 Sep 28 17:24:36 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:37 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4" returned: 0 in 0.401s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:37 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:24:37 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be82a61-3831-47eb-b8c5-c6e232ce9f02]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:37 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d Sep 28 17:24:37 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:37 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d" returned: 0 in 0.483s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:37 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:37 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4 Sep 28 17:24:37 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:38 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4" returned: 0 in 0.425s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:38 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4 Sep 28 17:24:38 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:38 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:38 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d.ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4" returned: 0 in 0.272s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4" released by "_delete_snapshot" :: held 1.706s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-a9d6df34-3f9f-45c3-aeab-38fcb897046d" released by "delete_snapshot" :: held 1.736s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:38 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] Created reservations ['b46cb4c9-dbc8-48df-b0b4-b63c9d30a781', 'e15f4c61-0595-4907-8383-0cb78d7740ab', 'd4698e30-d587-4de1-a3ba-b44cd0b8c66b', '6724cc75-8b35-4928-a810-b86880b8c551'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:38 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] Delete snapshot completed successfully. Sep 28 17:24:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-28064af1-5265-42b7-9f3a-1d470c7462c1 tempest-ProjectMemberTests-630479163 None] Lock "cinder-ba4ef4fe-3107-4e6e-a606-10f6e80d0ed4-delete_snapshot" released by "delete_snapshot" :: held 1.925s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-a9d6df34-3f9f-45c3-aeab-38fcb897046d-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] Lock "cinder-a9d6df34-3f9f-45c3-aeab-38fcb897046d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-a9d6df34-3f9f-45c3-aeab-38fcb897046d" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:38 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-a9d6df34-3f9f-45c3-aeab-38fcb897046d" acquired by "delete_volume" :: waited 0.022s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:39 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ad4be5-f557-4761-a2ca-50728ef0f812]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:39 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d Sep 28 17:24:39 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:39 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d" returned: 0 in 0.400s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:39 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d Sep 28 17:24:39 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:39 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:39 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-a9d6df34-3f9f-45c3-aeab-38fcb897046d" returned: 0 in 0.274s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:39 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-a9d6df34-3f9f-45c3-aeab-38fcb897046d" released by "delete_volume" :: held 0.764s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:39 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] Created reservations ['5b134d89-5ca3-4f2f-a58a-b5a8c76e5d62', '6b96fd0a-5a81-43a0-a357-d361026f2605', '0ce2f175-0501-4072-8bcc-7af39da890f2', '781adca3-a5eb-44b1-932d-456cccbea471'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:40 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:40 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:24:40 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:40 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:40 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.267s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:40 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:40 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] Deleted volume successfully. Sep 28 17:24:40 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-d87b0338-3f62-4475-a600-9e0df0826875 tempest-ProjectMemberTests-630479163 None] Lock "cinder-a9d6df34-3f9f-45c3-aeab-38fcb897046d-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (0da03e33-21d9-4bc3-a3b2-2de9e555f631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae17dfd-a101-4704-8b16-3dfd3fbc4192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae17dfd-a101-4704-8b16-3dfd3fbc4192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1051534083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93263f15-22e3-4af8-a842-07392b9b77d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:42Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f248626b-b7c4-483b-9723-7e2d69f209e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f248626b-b7c4-483b-9723-7e2d69f209e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d76d32d-3c98-4630-8581-b231fa77d4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d76d32d-3c98-4630-8581-b231fa77d4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93263f15-22e3-4af8-a842-07392b9b77d0', 'volume_name': 'volume-93263f15-22e3-4af8-a842-07392b9b77d0', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b899fe9-12e1-4940-9ec0-5862c5dd2aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b899fe9-12e1-4940-9ec0-5862c5dd2aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fae9b86-acb9-440a-98e7-524c35523357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:41 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Volume 93263f15-22e3-4af8-a842-07392b9b77d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93263f15-22e3-4af8-a842-07392b9b77d0', 'volume_size': 1} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1051534083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93263f15-22e3-4af8-a842-07392b9b77d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:42Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Creating volume 93263f15-22e3-4af8-a842-07392b9b77d0 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:41 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:24:41 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:41 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0 1073741824 Sep 28 17:24:41 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:42 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0 1073741824" returned: 0 in 0.460s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:42 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0 Sep 28 17:24:42 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:42 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0" returned: 0 in 0.276s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:42 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fae9b86-acb9-440a-98e7-524c35523357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93263f15-22e3-4af8-a842-07392b9b77d0', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2656033f-fcdd-42fb-8662-d4ecb0304428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:42 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Volume volume-93263f15-22e3-4af8-a842-07392b9b77d0 (93263f15-22e3-4af8-a842-07392b9b77d0): created successfully Sep 28 17:24:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2656033f-fcdd-42fb-8662-d4ecb0304428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (0da03e33-21d9-4bc3-a3b2-2de9e555f631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:42 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-73a049df-71c1-420c-9e8a-0eed9da6845a tempest-ProjectMemberTests-630479163 None] Created volume successfully. Sep 28 17:24:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] Creating offline snapshot b8d84648-0e59-4e81-a5c6-4768a60d4188 of volume 93263f15-22e3-4af8-a842-07392b9b77d0 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:24:43 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd6cc3a-425a-4f0f-af10-90d34d233627]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:44 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0 Sep 28 17:24:44 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:44 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0" returned: 0 in 0.439s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:44 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188 1G Sep 28 17:24:44 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:44 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188 1G" returned: 0 in 0.474s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93263f15-22e3-4af8-a842-07392b9b77d0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:44 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93263f15-22e3-4af8-a842-07392b9b77d0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188 Sep 28 17:24:44 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:45 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93263f15-22e3-4af8-a842-07392b9b77d0 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188" returned: 0 in 0.362s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:45 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188 is being set with open permissions: ugo+rw Sep 28 17:24:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:45 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188 Sep 28 17:24:45 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:45 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188" returned: 0 in 0.275s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:45 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.info Sep 28 17:24:45 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:45 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.info" returned: 0 in 0.266s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:45 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.info is being set with open permissions: ugo+rw Sep 28 17:24:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:45 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.info Sep 28 17:24:45 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:46 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.info" returned: 0 in 0.244s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:46 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-aadf7e1b-2a96-4b93-aa5f-00b6e1c3c506 tempest-ProjectMemberTests-630479163 None] Create snapshot completed successfully Sep 28 17:24:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-b8d84648-0e59-4e81-a5c6-4768a60d4188-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] Lock "cinder-b8d84648-0e59-4e81-a5c6-4768a60d4188-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-93263f15-22e3-4af8-a842-07392b9b77d0" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-93263f15-22e3-4af8-a842-07392b9b77d0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-b8d84648-0e59-4e81-a5c6-4768a60d4188" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-b8d84648-0e59-4e81-a5c6-4768a60d4188" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:47 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] Deleting offline snapshot b8d84648-0e59-4e81-a5c6-4768a60d4188 of volume 93263f15-22e3-4af8-a842-07392b9b77d0 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:24:47 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] snapshot_file for this snap is: volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:24:47 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d398d46-da41-47a6-9878-49032d5881e9]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:47 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188 Sep 28 17:24:47 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:47 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188" returned: 0 in 0.396s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:47 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93263f15-22e3-4af8-a842-07392b9b77d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:24:47 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ad4887-0df0-444e-88c9-06d7c05ce95c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:47 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0 Sep 28 17:24:47 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:48 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0" returned: 0 in 0.368s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:48 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188 Sep 28 17:24:48 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:48 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188" returned: 0 in 0.357s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:48 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188 Sep 28 17:24:48 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:48 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:48 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0.b8d84648-0e59-4e81-a5c6-4768a60d4188" returned: 0 in 0.263s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:48 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-b8d84648-0e59-4e81-a5c6-4768a60d4188" released by "_delete_snapshot" :: held 1.490s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:48 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-93263f15-22e3-4af8-a842-07392b9b77d0" released by "delete_snapshot" :: held 1.517s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:48 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] Created reservations ['ca9ec59a-64d2-486e-819f-9b1cb1204abc', 'f214397c-6d42-4d93-a7dd-b750a3500ef1', '37122151-bab1-4e8c-ba5c-254e76f1ce90', '99ed8480-ebd7-4771-9a8a-08597d2ba259'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:48 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] Delete snapshot completed successfully. Sep 28 17:24:48 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-0a1da46e-ac4f-4a4a-86b2-415501499d5c tempest-ProjectMemberTests-630479163 None] Lock "cinder-b8d84648-0e59-4e81-a5c6-4768a60d4188-delete_snapshot" released by "delete_snapshot" :: held 1.657s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:49 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-93263f15-22e3-4af8-a842-07392b9b77d0-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:49 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] Lock "cinder-93263f15-22e3-4af8-a842-07392b9b77d0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:49 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-93263f15-22e3-4af8-a842-07392b9b77d0" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:49 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-93263f15-22e3-4af8-a842-07392b9b77d0" acquired by "delete_volume" :: waited 0.016s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:49 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[689c83bb-a71b-4307-8775-4d7737fea7f1]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:49 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0 Sep 28 17:24:49 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:49 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0" returned: 0 in 0.385s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:49 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:49 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0 Sep 28 17:24:49 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:50 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-93263f15-22e3-4af8-a842-07392b9b77d0" returned: 0 in 0.269s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-93263f15-22e3-4af8-a842-07392b9b77d0" released by "delete_volume" :: held 0.734s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:50 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] Created reservations ['85086639-d701-4e5b-8d7b-9bdacf62e00c', '0810e383-a7b9-4a4a-ac45-130fffa05409', '2a9aa1cf-a313-4404-84c5-221cda2f8b71', '174bbbb0-c5b7-4cdf-9258-7820a3f38ca3'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:50 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:50 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:24:50 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:50 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:50 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.286s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:50 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:50 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] Deleted volume successfully. Sep 28 17:24:50 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-48f0f775-7beb-410f-848b-b0c2b12241d5 tempest-ProjectMemberTests-630479163 None] Lock "cinder-93263f15-22e3-4af8-a842-07392b9b77d0-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:50 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (da11de76-7710-4591-95cb-1864d1290234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f005a47-c264-432c-98fc-309dad0b9e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f005a47-c264-432c-98fc-309dad0b9e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-240958048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee1efc4-f956-4ae3-b3d1-21f81afbd671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:51Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94409152-7c6d-42d4-9387-e61568744bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94409152-7c6d-42d4-9387-e61568744bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5cf172-6372-4cf1-bd80-f15a4ebba38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5cf172-6372-4cf1-bd80-f15a4ebba38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fee1efc4-f956-4ae3-b3d1-21f81afbd671', 'volume_name': 'volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd7015a-2edf-4e83-8ddf-d1c0163a02ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd7015a-2edf-4e83-8ddf-d1c0163a02ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3499b4c4-4f2d-40ab-a946-cf48db73c017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:51 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Volume fee1efc4-f956-4ae3-b3d1-21f81afbd671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671', 'volume_size': 1} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-240958048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee1efc4-f956-4ae3-b3d1-21f81afbd671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:51Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Creating volume fee1efc4-f956-4ae3-b3d1-21f81afbd671 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:51 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:51 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671 1073741824 Sep 28 17:24:51 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:51 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671 1073741824" returned: 0 in 0.423s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:51 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671 Sep 28 17:24:51 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:51 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671" returned: 0 in 0.241s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3499b4c4-4f2d-40ab-a946-cf48db73c017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ecb9dae-6c7d-4ac4-81ff-c59852f3aa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:51 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Volume volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671 (fee1efc4-f956-4ae3-b3d1-21f81afbd671): created successfully Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ecb9dae-6c7d-4ac4-81ff-c59852f3aa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:51 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (da11de76-7710-4591-95cb-1864d1290234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:51 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-275fcd47-d897-479c-8bba-5a70450e6c58 tempest-ProjectMemberTests-630479163 None] Created volume successfully. Sep 28 17:24:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:52 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] Creating offline snapshot 1bcfce5e-b5c2-40aa-b000-32ac16372eaa of volume fee1efc4-f956-4ae3-b3d1-21f81afbd671 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:24:52 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d08bcd-dca9-4a9d-8697-e9b17a00256c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:52 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671 Sep 28 17:24:52 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:52 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671" returned: 0 in 0.375s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:52 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:52 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa 1G Sep 28 17:24:52 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:53 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa 1G" returned: 0 in 0.431s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:53 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa Sep 28 17:24:53 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:53 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa" returned: 0 in 0.309s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:53 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa is being set with open permissions: ugo+rw Sep 28 17:24:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:53 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa Sep 28 17:24:53 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:53 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa" returned: 0 in 0.254s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:53 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.info Sep 28 17:24:53 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:53 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.info" returned: 0 in 0.257s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:53 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.info is being set with open permissions: ugo+rw Sep 28 17:24:53 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:53 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.info Sep 28 17:24:53 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:54 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.info" returned: 0 in 0.258s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:54 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0c481051-f80b-4b68-b209-c3317300187a tempest-ProjectMemberTests-630479163 None] Create snapshot completed successfully Sep 28 17:24:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-1bcfce5e-b5c2-40aa-b000-32ac16372eaa-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] Lock "cinder-1bcfce5e-b5c2-40aa-b000-32ac16372eaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-fee1efc4-f956-4ae3-b3d1-21f81afbd671" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-fee1efc4-f956-4ae3-b3d1-21f81afbd671" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-1bcfce5e-b5c2-40aa-b000-32ac16372eaa" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:54 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-1bcfce5e-b5c2-40aa-b000-32ac16372eaa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] Deleting offline snapshot 1bcfce5e-b5c2-40aa-b000-32ac16372eaa of volume fee1efc4-f956-4ae3-b3d1-21f81afbd671 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:24:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] snapshot_file for this snap is: volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:24:54 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee995089-841b-48b9-b988-f31e8fc130dd]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:54 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa Sep 28 17:24:54 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:54 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa" returned: 0 in 0.409s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:54 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:24:54 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbb5936-8ae7-4982-ae0d-18d17fd6adcd]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:54 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:54 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671 Sep 28 17:24:54 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:55 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671" returned: 0 in 0.390s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:55 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa Sep 28 17:24:55 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:55 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa" returned: 0 in 0.357s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:55 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa Sep 28 17:24:55 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:55 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671.1bcfce5e-b5c2-40aa-b000-32ac16372eaa" returned: 0 in 0.245s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-1bcfce5e-b5c2-40aa-b000-32ac16372eaa" released by "_delete_snapshot" :: held 1.506s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:55 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-fee1efc4-f956-4ae3-b3d1-21f81afbd671" released by "delete_snapshot" :: held 1.529s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:55 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] Created reservations ['443d683d-67ce-40eb-9030-0b4420cf6b0d', '35a7ffaf-ed72-4198-8b88-68b7fee82dd5', '482857c4-e658-4890-8027-5d14a7975354', 'd0daf6b1-689c-413d-a8f3-932f61bc12ff'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:55 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] Delete snapshot completed successfully. Sep 28 17:24:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-db4f45f2-2240-4e68-853a-0287305607c8 tempest-ProjectMemberTests-630479163 None] Lock "cinder-1bcfce5e-b5c2-40aa-b000-32ac16372eaa-delete_snapshot" released by "delete_snapshot" :: held 1.666s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-fee1efc4-f956-4ae3-b3d1-21f81afbd671-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] Lock "cinder-fee1efc4-f956-4ae3-b3d1-21f81afbd671-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-fee1efc4-f956-4ae3-b3d1-21f81afbd671" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:56 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-fee1efc4-f956-4ae3-b3d1-21f81afbd671" acquired by "delete_volume" :: waited 0.022s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:56 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[af296214-c82f-4859-ba08-677f0d3358f8]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:56 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671 Sep 28 17:24:56 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:56 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671" returned: 0 in 0.390s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:56 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:57 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671 Sep 28 17:24:57 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:57 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-fee1efc4-f956-4ae3-b3d1-21f81afbd671" returned: 0 in 0.271s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-fee1efc4-f956-4ae3-b3d1-21f81afbd671" released by "delete_volume" :: held 0.730s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:57 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] Created reservations ['94f30d38-3a77-427e-b7a7-1e47ceebfa15', 'aada8f73-cc22-4152-999f-0bd60bf2209c', 'fe722a61-a27c-4cfc-b843-01e79aa4d043', '62cf4d4e-c1a8-4fdc-8e82-458ade449456'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:57 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:57 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:24:57 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:57 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:57 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.292s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:57 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:57 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] Deleted volume successfully. Sep 28 17:24:57 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-c688818e-8f7d-4c9b-9b62-f32924466519 tempest-ProjectMemberTests-630479163 None] Lock "cinder-fee1efc4-f956-4ae3-b3d1-21f81afbd671-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (edf9499f-b08d-4a00-8a0a-4b0518c13cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a60042-bc35-445e-b5c3-2c57710d6a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a60042-bc35-445e-b5c3-2c57710d6a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1694770893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e803c3c9-2297-4f2e-801f-edaf01384354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:58Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5dd1a67-2e68-4a9f-9eaa-616991d4602c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5dd1a67-2e68-4a9f-9eaa-616991d4602c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494968dd-e98b-476f-b5fa-07416a26d5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494968dd-e98b-476f-b5fa-07416a26d5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e803c3c9-2297-4f2e-801f-edaf01384354', 'volume_name': 'volume-e803c3c9-2297-4f2e-801f-edaf01384354', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaabf1ab-c07d-440b-ac3c-1aac1413e36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaabf1ab-c07d-440b-ac3c-1aac1413e36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40c8272-c495-4878-8d1f-c06603f8d575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:58 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Volume e803c3c9-2297-4f2e-801f-edaf01384354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e803c3c9-2297-4f2e-801f-edaf01384354', 'volume_size': 1} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1694770893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e803c3c9-2297-4f2e-801f-edaf01384354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a0a2cb4354636937e666577f7b0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:58Z,use_quota=True,user_id='a3ec08d1165a4d69b2f33c6a2d4b173b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Creating volume e803c3c9-2297-4f2e-801f-edaf01384354 {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:58 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:58 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354 1073741824 Sep 28 17:24:58 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:58 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354 1073741824" returned: 0 in 0.494s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:58 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:58 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354 Sep 28 17:24:58 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:59 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354" returned: 0 in 0.271s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:59 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:59 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40c8272-c495-4878-8d1f-c06603f8d575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e803c3c9-2297-4f2e-801f-edaf01384354', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ca7ce8-fb5f-45b0-b461-0643608dd5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:59 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Volume volume-e803c3c9-2297-4f2e-801f-edaf01384354 (e803c3c9-2297-4f2e-801f-edaf01384354): created successfully Sep 28 17:24:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ca7ce8-fb5f-45b0-b461-0643608dd5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:59 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Flow 'volume_create_manager' (edf9499f-b08d-4a00-8a0a-4b0518c13cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:59 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-6ca7c5a0-c711-4495-ab93-dc43dc510c1e tempest-ProjectMemberTests-630479163 None] Created volume successfully. Sep 28 17:25:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:00 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] Creating offline snapshot 40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a of volume e803c3c9-2297-4f2e-801f-edaf01384354 {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:25:00 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefbe001-4da0-415f-944a-218e01ceccb9]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:00 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354 Sep 28 17:25:00 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:00 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354" returned: 0 in 0.390s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:00 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:00 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a 1G Sep 28 17:25:00 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:25:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:01 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:25:01 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:01 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a 1G" returned: 0 in 0.495s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e803c3c9-2297-4f2e-801f-edaf01384354 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:01 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e803c3c9-2297-4f2e-801f-edaf01384354 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a Sep 28 17:25:01 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:01 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.327s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:25:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:25:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:25:01 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e803c3c9-2297-4f2e-801f-edaf01384354 -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a" returned: 0 in 0.325s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:01 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a is being set with open permissions: ugo+rw Sep 28 17:25:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:01 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a Sep 28 17:25:01 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:01 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a" returned: 0 in 0.261s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:02 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.info Sep 28 17:25:02 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:02 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.info" returned: 0 in 0.270s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:02 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.info is being set with open permissions: ugo+rw Sep 28 17:25:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:02 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.info Sep 28 17:25:02 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:02 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.info" returned: 0 in 0.260s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:02 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.090s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:02 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-4e93b35b-c9ae-42c9-8128-436a96100391 tempest-ProjectMemberTests-630479163 None] Create snapshot completed successfully Sep 28 17:25:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] Lock "cinder-40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-e803c3c9-2297-4f2e-801f-edaf01384354" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-e803c3c9-2297-4f2e-801f-edaf01384354" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:03 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] Deleting offline snapshot 40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a of volume e803c3c9-2297-4f2e-801f-edaf01384354 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:25:03 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] snapshot_file for this snap is: volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:25:03 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3679a5c-db8d-4d6e-8cc1-ed0b7461cec0]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:03 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:03 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a Sep 28 17:25:03 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:04 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a" returned: 0 in 0.385s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:04 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e803c3c9-2297-4f2e-801f-edaf01384354(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:25:04 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c102da6-1024-4249-8eac-c0012d437a80]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:04 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354 Sep 28 17:25:04 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:04 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354" returned: 0 in 0.389s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:04 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a Sep 28 17:25:04 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:04 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a" returned: 0 in 0.351s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:04 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:05 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a Sep 28 17:25:05 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:05 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:05 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354.40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a" returned: 0 in 0.261s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a" released by "_delete_snapshot" :: held 1.487s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-e803c3c9-2297-4f2e-801f-edaf01384354" released by "delete_snapshot" :: held 1.509s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:05 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] Created reservations ['ffa0e021-07ad-436a-a221-4991e88007ca', 'd80c8167-f3af-4343-afb7-56c322151fdf', '407d0afd-3678-4061-a2dd-a1914c80e918', '1cce7ed1-bb27-4080-b6c0-b7097dc64ae5'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:05 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] Delete snapshot completed successfully. Sep 28 17:25:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-88b50cea-ce97-41b2-8434-ed88d30f2aae tempest-ProjectMemberTests-630479163 None] Lock "cinder-40e7ec33-d91d-4f44-9e30-b9d3f0f9d07a-delete_snapshot" released by "delete_snapshot" :: held 1.652s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-e803c3c9-2297-4f2e-801f-edaf01384354-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:05 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] Lock "cinder-e803c3c9-2297-4f2e-801f-edaf01384354-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] Acquiring lock "cinder-quobyte-e803c3c9-2297-4f2e-801f-edaf01384354" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-e803c3c9-2297-4f2e-801f-edaf01384354" acquired by "delete_volume" :: waited 0.023s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:06 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf645b6-dd97-4156-b3df-b57f07de2217]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:06 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354 Sep 28 17:25:06 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:06 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354" returned: 0 in 0.377s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:06 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354 Sep 28 17:25:06 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:06 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-e803c3c9-2297-4f2e-801f-edaf01384354" returned: 0 in 0.253s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:06 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] Lock "cinder-quobyte-e803c3c9-2297-4f2e-801f-edaf01384354" released by "delete_volume" :: held 0.718s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:06 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] Created reservations ['86622279-23a1-4875-af64-d612569763a1', '7ff9fb6c-7534-49e2-bd3b-6a0632037786', '3480d95c-b830-4a56-a735-5215d62b43ae', '3358cfe1-2eea-4d11-8e41-26f5f65aa027'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:06 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:06 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:06 devstack sudo[108560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:25:06 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:07 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:07 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.255s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:07 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:07 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] Deleted volume successfully. Sep 28 17:25:07 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-ab4a21ad-06c2-4c54-be1f-a085db418647 tempest-ProjectMemberTests-630479163 None] Lock "cinder-e803c3c9-2297-4f2e-801f-edaf01384354-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:16 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:DELETE=11,cinder:SELECT=80,cinder:INSERT=29,cinder:UPDATE=102 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:25:17 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=77,cinder:INSERT=29,cinder:UPDATE=109,cinder:DELETE=7 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Flow 'volume_create_manager' (0cc5d81d-a36a-4086-a21e-f84c8e3e122b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf205fa9-680a-44c8-ae59-201e87489f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf205fa9-680a-44c8-ae59-201e87489f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-619609004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7b164f-6418-4e23-a470-7d91a6e43fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5682461b344475b49dc64baf3ed002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:31Z,use_quota=True,user_id='aedc906ad20e49f0a7241f336e2873df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c775152-60b7-4878-ab0e-57164ab0bebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c775152-60b7-4878-ab0e-57164ab0bebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b088842b-a7d1-48ab-8aeb-5dbb49c50bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b088842b-a7d1-48ab-8aeb-5dbb49c50bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c7b164f-6418-4e23-a470-7d91a6e43fee', 'volume_name': 'volume-5c7b164f-6418-4e23-a470-7d91a6e43fee', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bfc81f-d064-4ea6-8b49-1ecc27aef88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bfc81f-d064-4ea6-8b49-1ecc27aef88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d06c5a-292e-4675-952c-c861018b7e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:30 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Volume 5c7b164f-6418-4e23-a470-7d91a6e43fee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c7b164f-6418-4e23-a470-7d91a6e43fee', 'volume_size': 1} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-619609004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7b164f-6418-4e23-a470-7d91a6e43fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5682461b344475b49dc64baf3ed002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:31Z,use_quota=True,user_id='aedc906ad20e49f0a7241f336e2873df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)}" {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Creating volume 5c7b164f-6418-4e23-a470-7d91a6e43fee {{(pid=86970) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:30 devstack cinder-volume[86970]: INFO cinder.volume.drivers.remotefs [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] casted to osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 Sep 28 17:25:30 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee 1073741824 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:30 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee 1073741824 Sep 28 17:25:30 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:31 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee 1073741824" returned: 0 in 0.448s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:31 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee Sep 28 17:25:31 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:31 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee" returned: 0 in 0.258s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:31 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'} {{(pid=86970) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:31 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d06c5a-292e-4675-952c-c861018b7e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c7b164f-6418-4e23-a470-7d91a6e43fee', 'volume_size': 1}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeda401f-17f9-4faf-b722-f69b05f6b252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:31 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Volume volume-5c7b164f-6418-4e23-a470-7d91a6e43fee (5c7b164f-6418-4e23-a470-7d91a6e43fee): created successfully Sep 28 17:25:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeda401f-17f9-4faf-b722-f69b05f6b252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:31 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Flow 'volume_create_manager' (0cc5d81d-a36a-4086-a21e-f84c8e3e122b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:31 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-5af32b6c-9e67-4c0d-81b0-67e22b2a7977 tempest-SnapshotDependencyTests-881586447 None] Created volume successfully. Sep 28 17:25:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:32 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] Creating offline snapshot 437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 of volume 5c7b164f-6418-4e23-a470-7d91a6e43fee {{(pid=86970) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:25:32 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd5c86e-43e0-4ad4-b660-70f461a91fcb]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:32 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee Sep 28 17:25:32 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:32 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee" returned: 0 in 0.363s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 1G {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:32 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 1G Sep 28 17:25:32 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:32 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 1G" returned: 0 in 0.420s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:32 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c7b164f-6418-4e23-a470-7d91a6e43fee -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:32 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c7b164f-6418-4e23-a470-7d91a6e43fee -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 Sep 28 17:25:32 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:33 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c7b164f-6418-4e23-a470-7d91a6e43fee -F qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3" returned: 0 in 0.319s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:33 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 is being set with open permissions: ugo+rw Sep 28 17:25:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:33 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 Sep 28 17:25:33 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:33 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3" returned: 0 in 0.275s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:33 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.info Sep 28 17:25:33 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:33 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.info" returned: 0 in 0.287s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:33 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.info is being set with open permissions: ugo+rw Sep 28 17:25:33 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.info {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:33 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.info Sep 28 17:25:33 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:34 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.info" returned: 0 in 0.299s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:34 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:34 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-0651679f-6303-4e21-b9c9-715a25370ea4 tempest-SnapshotDependencyTests-881586447 None] Create snapshot completed successfully Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86970) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Flow 'volume_create_manager' (09e82853-9d0e-46c0-94a7-bc62b241f496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589c5b81-5fb2-4043-a271-7c9196c453a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589c5b81-5fb2-4043-a271-7c9196c453a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2974d721-f175-4318-87fc-d0cda9b962cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5682461b344475b49dc64baf3ed002',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=437fa85b-7cfd-49df-9bbe-7a6eb85c0db3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:36Z,use_quota=True,user_id='aedc906ad20e49f0a7241f336e2873df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249f0834-f4f8-479b-871f-d999c9c497fd),volume_type_id=249f0834-f4f8-479b-871f-d999c9c497fd)' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab4b0e3-75f3-4f29-8081-743cff7474c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab4b0e3-75f3-4f29-8081-743cff7474c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0d31fd-1307-4d8f-b2c9-53576a1fb3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0d31fd-1307-4d8f-b2c9-53576a1fb3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2974d721-f175-4318-87fc-d0cda9b962cf', 'volume_name': 'volume-2974d721-f175-4318-87fc-d0cda9b962cf', 'volume_size': 1, 'snapshot_id': '437fa85b-7cfd-49df-9bbe-7a6eb85c0db3'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899031f9-e5dc-48f8-8142-0af1f0de72b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899031f9-e5dc-48f8-8142-0af1f0de72b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f761ec-dec1-4cea-aa79-82f8f03bc97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Volume 2974d721-f175-4318-87fc-d0cda9b962cf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2974d721-f175-4318-87fc-d0cda9b962cf', 'volume_size': 1, 'snapshot_id': '437fa85b-7cfd-49df-9bbe-7a6eb85c0db3'} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Acquiring lock "cinder-quobyte-437fa85b-7cfd-49df-9bbe-7a6eb85c0db3-2974d721-f175-4318-87fc-d0cda9b962cf" by "_create_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-quobyte-437fa85b-7cfd-49df-9bbe-7a6eb85c0db3-2974d721-f175-4318-87fc-d0cda9b962cf" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Creating volume 2974d721-f175-4318-87fc-d0cda9b962cf from snapshot 437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 {{(pid=86970) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Selected osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973 as target Quobyte volume. {{(pid=86970) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:35 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Acquiring lock "cinder-quobyte-2974d721-f175-4318-87fc-d0cda9b962cf" by "_copy_volume_from_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-quobyte-2974d721-f175-4318-87fc-d0cda9b962cf" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] snapshot: 437fa85b-7cfd-49df-9bbe-7a6eb85c0db3, volume: 2974d721-f175-4318-87fc-d0cda9b962cf, {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f46a4aa-ad94-476d-bd39-5ab81352b87c]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:36 devstack sudo[108688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 Sep 28 17:25:36 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:36 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3" returned: 0 in 0.382s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c7b164f-6418-4e23-a470-7d91a6e43fee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a3179f-5ef9-47b5-9562-fd9e62d71150]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:36 devstack sudo[108694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee Sep 28 17:25:36 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:36 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee" returned: 0 in 0.402s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Creating direct copy from snapshot {{(pid=86970) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG cinder.utils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Path /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2974d721-f175-4318-87fc-d0cda9b962cf not found in is_blk_device check {{(pid=86970) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:25:36 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2974d721-f175-4318-87fc-d0cda9b962cf {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:36 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2974d721-f175-4318-87fc-d0cda9b962cf Sep 28 17:25:36 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:42 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2974d721-f175-4318-87fc-d0cda9b962cf" returned: 0 in 5.642s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:42 devstack cinder-volume[86970]: DEBUG cinder.image.image_utils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Image conversion details: src /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2974d721-f175-4318-87fc-d0cda9b962cf {{(pid=86970) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:25:42 devstack cinder-volume[86970]: INFO cinder.image.image_utils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Converted 1024.00 MB image at 181.45 MB/s Sep 28 17:25:42 devstack cinder-volume[86970]: WARNING cinder.volume.drivers.remotefs [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2974d721-f175-4318-87fc-d0cda9b962cf is being set with open permissions: ugo+rw Sep 28 17:25:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2974d721-f175-4318-87fc-d0cda9b962cf {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:42 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2974d721-f175-4318-87fc-d0cda9b962cf Sep 28 17:25:42 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:42 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2974d721-f175-4318-87fc-d0cda9b962cf" returned: 0 in 0.280s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-quobyte-2974d721-f175-4318-87fc-d0cda9b962cf" released by "_copy_volume_from_snapshot" :: held 6.790s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:42 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-quobyte-437fa85b-7cfd-49df-9bbe-7a6eb85c0db3-2974d721-f175-4318-87fc-d0cda9b962cf" released by "_create_volume_from_snapshot" :: held 6.852s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:42 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.868s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f761ec-dec1-4cea-aa79-82f8f03bc97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2974d721-f175-4318-87fc-d0cda9b962cf', 'volume_size': 1, 'snapshot_id': '437fa85b-7cfd-49df-9bbe-7a6eb85c0db3'}' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe121d4-7e24-44a1-9027-d6ed1562a408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:42 devstack cinder-volume[86970]: INFO cinder.volume.flows.manager.create_volume [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Volume volume-2974d721-f175-4318-87fc-d0cda9b962cf (2974d721-f175-4318-87fc-d0cda9b962cf): created successfully Sep 28 17:25:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe121d4-7e24-44a1-9027-d6ed1562a408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86970) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:42 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Flow 'volume_create_manager' (09e82853-9d0e-46c0-94a7-bc62b241f496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86970) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:42 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-00e0c693-18e2-44cd-85b9-b635af4b4bb0 tempest-SnapshotDependencyTests-881586447 None] Created volume successfully. Sep 28 17:25:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] Acquiring lock "cinder-437fa85b-7cfd-49df-9bbe-7a6eb85c0db3-delete_snapshot" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-437fa85b-7cfd-49df-9bbe-7a6eb85c0db3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] Acquiring lock "cinder-quobyte-5c7b164f-6418-4e23-a470-7d91a6e43fee" by "delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-quobyte-5c7b164f-6418-4e23-a470-7d91a6e43fee" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] Acquiring lock "cinder-quobyte-437fa85b-7cfd-49df-9bbe-7a6eb85c0db3" by "_delete_snapshot" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:43 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-quobyte-437fa85b-7cfd-49df-9bbe-7a6eb85c0db3" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] Deleting offline snapshot 437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 of volume 5c7b164f-6418-4e23-a470-7d91a6e43fee {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:25:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] snapshot_file for this snap is: volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 {{(pid=86970) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:25:43 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e79dfa2-e78a-424c-a08d-ae8447353f88]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:43 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 Sep 28 17:25:43 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:43 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:43 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3" returned: 0 in 0.364s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:43 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.remotefs [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c7b164f-6418-4e23-a470-7d91a6e43fee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86970) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:25:44 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[edda46fc-c62f-4a57-90ad-61ff36859cf0]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:44 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee Sep 28 17:25:44 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:44 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee" returned: 0 in 0.519s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:44 devstack sudo[108729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 Sep 28 17:25:44 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:44 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3" returned: 0 in 0.365s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:44 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:44 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3 Sep 28 17:25:44 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:45 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee.437fa85b-7cfd-49df-9bbe-7a6eb85c0db3" returned: 0 in 0.248s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-quobyte-437fa85b-7cfd-49df-9bbe-7a6eb85c0db3" released by "_delete_snapshot" :: held 1.604s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-quobyte-5c7b164f-6418-4e23-a470-7d91a6e43fee" released by "delete_snapshot" :: held 1.624s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:45 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] Created reservations ['62fcce40-c127-4034-821d-faf7c2f58405', '878a3a02-046d-4dfa-88b0-def91ef653de', '9e5e8c54-86c3-4829-b81d-919308398bac', 'd3fbfa95-b6e4-48b1-a321-7e2c6895c0a6'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:45 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] Delete snapshot completed successfully. Sep 28 17:25:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-32ba846f-74e4-4d3c-a757-84ba53e49a08 tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-437fa85b-7cfd-49df-9bbe-7a6eb85c0db3-delete_snapshot" released by "delete_snapshot" :: held 1.768s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] Acquiring lock "cinder-5c7b164f-6418-4e23-a470-7d91a6e43fee-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-5c7b164f-6418-4e23-a470-7d91a6e43fee-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] Acquiring lock "cinder-quobyte-5c7b164f-6418-4e23-a470-7d91a6e43fee" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:45 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-quobyte-5c7b164f-6418-4e23-a470-7d91a6e43fee" acquired by "delete_volume" :: waited 0.016s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:45 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3d51c4-6463-47b5-8cf8-b7596a4759de]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:45 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:45 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee Sep 28 17:25:45 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:46 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee" returned: 0 in 0.369s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:46 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee Sep 28 17:25:46 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:46 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-5c7b164f-6418-4e23-a470-7d91a6e43fee" returned: 0 in 0.243s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-quobyte-5c7b164f-6418-4e23-a470-7d91a6e43fee" released by "delete_volume" :: held 0.677s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] Created reservations ['b68139bf-b7e0-4198-98f4-852e4e2a4790', '8a9f2975-a922-4ec5-a691-8987481186e5', 'aadc04c4-1697-409c-ba4a-c0c855519002', '6af6463b-7963-4c45-bafc-a737bceff482'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:46 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:25:46 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:46 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.249s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:46 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] Deleted volume successfully. Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-4a35f469-28d6-4416-b8c4-694b10d8b347 tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-5c7b164f-6418-4e23-a470-7d91a6e43fee-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] Acquiring lock "cinder-2974d721-f175-4318-87fc-d0cda9b962cf-delete_volume" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-2974d721-f175-4318-87fc-d0cda9b962cf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] Acquiring lock "cinder-quobyte-2974d721-f175-4318-87fc-d0cda9b962cf" by "delete_volume" {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-quobyte-2974d721-f175-4318-87fc-d0cda9b962cf" acquired by "delete_volume" :: waited 0.014s {{(pid=86970) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d80985a-fe46-4de2-bd8f-1ff9d1894309]: (4, 'qcow2') {{(pid=88482) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:46 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2974d721-f175-4318-87fc-d0cda9b962cf {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:47 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2974d721-f175-4318-87fc-d0cda9b962cf Sep 28 17:25:47 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:47 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2974d721-f175-4318-87fc-d0cda9b962cf" returned: 0 in 0.345s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2974d721-f175-4318-87fc-d0cda9b962cf {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:47 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2974d721-f175-4318-87fc-d0cda9b962cf Sep 28 17:25:47 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:47 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c/volume-2974d721-f175-4318-87fc-d0cda9b962cf" returned: 0 in 0.239s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-quobyte-2974d721-f175-4318-87fc-d0cda9b962cf" released by "delete_volume" :: held 0.625s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:47 devstack cinder-volume[86970]: DEBUG cinder.quota [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] Created reservations ['8668dfa1-7693-4857-8eeb-2ae4d5a23364', '7a757dae-08d8-448a-8d88-195c08f2cb7c', 'b72da771-c94a-40e8-a4ef-73bec620ff12', 'bafe0ef4-6c1c-4004-8b4e-1bdcd59748e0'] {{(pid=86970) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:47 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:47 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:47 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:25:47 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:47 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:47 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.249s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:47 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:47 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] Deleted volume successfully. Sep 28 17:25:47 devstack cinder-volume[86970]: DEBUG cinder.coordination [None req-37e9f7cb-0b65-4e6e-95b4-52e86140007e tempest-SnapshotDependencyTests-881586447 None] Lock "cinder-2974d721-f175-4318-87fc-d0cda9b962cf-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=86970) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:57 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=23,cinder:UPDATE=30,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:25:57 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=26,cinder:INSERT=12,cinder:UPDATE=28,cinder:DELETE=3 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:26:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:26:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973': None} {{(pid=86970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:01 devstack cinder-volume[86970]: DEBUG cinder.volume.drivers.quobyte [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a35205d3-ee15-4929-bccb-aa9bae8ef973'] {{(pid=86970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:01 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c Sep 28 17:26:01 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:01 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:01 devstack cinder-volume[86970]: DEBUG oslo_concurrency.processutils [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3db7d766fd16168d523f1544b6e2d10c" returned: 0 in 0.267s {{(pid=86970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:01 devstack cinder-volume[86970]: DEBUG cinder.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Notifying Schedulers of capabilities ... {{(pid=86970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:01 devstack cinder-volume[86970]: DEBUG oslo_service.periodic_task [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] Running periodic task VolumeManager._thread_info {{(pid=86970) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:26:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread count: 28 {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:26:01 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-7e5aa1e5-645d-4836-ad57-42935faa408e None None] thread info: [<_MainThread(MainThread, started 128150105243776)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86970) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:26:12 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=1 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:26:12 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:UPDATE=1 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}